[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:56:56 dist-test-slave-cbsf krb5kdc[7788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:56:56 dist-test-slave-cbsf krb5kdc[7788](info): set up 2 sockets
Aug 06 16:56:56 dist-test-slave-cbsf krb5kdc[7788](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 16:56:57.770876 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.001s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:56:57 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:56:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:56:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:56:57.916332 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:43195
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:43195
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:56:58.048153 7803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:56:58.048542 7803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:56:58.048592 7803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:56:58.053337 7803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:56:58.053445 7803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:56:58.053467 7803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:56:58.053484 7803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:56:58.053501 7803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:56:58.059517 7803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:43195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:43195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:56:58.060875 7803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:56:58.062071 7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:56:58.073633 7811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:56:58.073729 7803 server_base.cc:1034] running on GCE node
W20260806 16:56:58.073612 7809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:56:58.075387 7808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:56:58.076296 7803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:56:58.077793 7803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:56:58.079025 7803 hybrid_clock.cc:648] HybridClock initialized: now 1786035418079034 us; error 81 us; skew 500 ppm
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:56:58.082532 7803 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:56:58.083804 7803 webserver.cc:460] Webserver started at http://127.7.153.62:36417/ using document root <none> and password file <none>
I20260806 16:56:58.084494 7803 fs_manager.cc:359] Metadata directory not provided
I20260806 16:56:58.084596 7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:56:58.084918 7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:56:58.087421 7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "0f480ac97aaf81d29123797a2d5efef2"
server_key_iv: "e9be32cddbbdd5a96e0fe48fd28aeeb6"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.088368 7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "0f480ac97aaf81d29123797a2d5efef2"
server_key_iv: "e9be32cddbbdd5a96e0fe48fd28aeeb6"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.095002 7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 16:56:58.098330 7818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.100222 7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:56:58.100454 7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "0f480ac97aaf81d29123797a2d5efef2"
server_key_iv: "e9be32cddbbdd5a96e0fe48fd28aeeb6"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.100625 7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:56:58.125197 7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:56:58.129220 7803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:56:58.129467 7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:56:58.138482 7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:43195
I20260806 16:56:58.138504 7870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:43195 every 8 connection(s)
I20260806 16:56:58.139600 7803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:56:58.143235 7871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:56:58.146037 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 7803
I20260806 16:56:58.146181 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:56:58.147572 7780 external_mini_cluster.cc:1428] Setting key 256220e35085abf8bb0953500774d4d8
I20260806 16:56:58.149807 7871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b: Bootstrap starting.
I20260806 16:56:58.152642 7871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b: Neither blocks nor log segments found. Creating new log.
I20260806 16:56:58.153584 7871 log.cc:824] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b: Log is configured to *not* fsync() on all Append() calls
I20260806 16:56:58.156015 7871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b: No bootstrap required, opened a new log
I20260806 16:56:58.160633 7871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 43195 } }
I20260806 16:56:58.160974 7871 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:56:58.161077 7871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00c95cf8ef6a4aa3a73f43b49bbab36b, State: Initialized, Role: FOLLOWER
I20260806 16:56:58.161625 7871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 43195 } }
I20260806 16:56:58.161782 7871 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:56:58.161835 7871 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:56:58.161928 7871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:56:58.163014 7871 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 43195 } }
I20260806 16:56:58.163407 7871 leader_election.cc:302] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00c95cf8ef6a4aa3a73f43b49bbab36b; no voters:
I20260806 16:56:58.163816 7871 leader_election.cc:288] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:56:58.163947 7876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:56:58.164245 7876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [term 1 LEADER]: Becoming Leader. State: Replica: 00c95cf8ef6a4aa3a73f43b49bbab36b, State: Running, Role: LEADER
I20260806 16:56:58.164608 7876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 43195 } }
I20260806 16:56:58.165263 7871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:56:58.166627 7877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00c95cf8ef6a4aa3a73f43b49bbab36b. Latest consensus state: current_term: 1 leader_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 43195 } } }
I20260806 16:56:58.166769 7877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [sys.catalog]: This master's current role is: LEADER
I20260806 16:56:58.166816 7878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c95cf8ef6a4aa3a73f43b49bbab36b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 43195 } } }
I20260806 16:56:58.166905 7878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b [sys.catalog]: This master's current role is: LEADER
I20260806 16:56:58.167251 7885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:56:58.171674 7885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:56:58.178759 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.151019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48558 (local address 127.7.153.62:43195)
0806 16:56:58.151646 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0806 16:56:58.151674 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 16:56:58.152989 (+ 1315us) server_negotiation.cc:407] Connection header received
0806 16:56:58.156913 (+ 3924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:56:58.156938 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:56:58.157427 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:56:58.157842 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:56:58.160374 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.162099 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.163735 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.164452 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.164618 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.170541 (+ 5923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:56:58.170549 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:56:58.170565 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:56:58.170607 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:56:58.173901 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:58.174763 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:58.174770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:58.174776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:58.175057 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:58.175491 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:58.175494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:58.175496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:58.176163 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:56:58.176353 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 16:56:58.177470 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0806 16:56:58.177775 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":168,"threads_started":1}
I20260806 16:56:58.179800 7885 catalog_manager.cc:1347] Generated new cluster ID: c20ac5579a3c4d2992296a634a65632e
I20260806 16:56:58.179864 7885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:56:58.185369 7885 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:56:58.186484 7885 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:56:58.194104 7885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00c95cf8ef6a4aa3a73f43b49bbab36b: Generated new TSK 0
I20260806 16:56:58.195055 7885 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:56:58.232234 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:43195
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:56:58.369287 7897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:56:58.369625 7897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:56:58.369674 7897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:56:58.374334 7897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:56:58.374425 7897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:56:58.374491 7897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:56:58.380860 7897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:43195
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:56:58.382136 7897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:56:58.383347 7897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:56:58.394304 7902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:56:58.394409 7905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:56:58.394418 7903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:56:58.394651 7897 server_base.cc:1034] running on GCE node
I20260806 16:56:58.395215 7897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:56:58.395978 7897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:56:58.397192 7897 hybrid_clock.cc:648] HybridClock initialized: now 1786035418397151 us; error 53 us; skew 500 ppm
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:56:58.400566 7897 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:56:58.401715 7897 webserver.cc:460] Webserver started at http://127.7.153.1:36299/ using document root <none> and password file <none>
I20260806 16:56:58.402364 7897 fs_manager.cc:359] Metadata directory not provided
I20260806 16:56:58.402463 7897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:56:58.402729 7897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:56:58.405325 7897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "77f98017cacb4dba88dab80c8248bcda"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "49575cc1b673e96aea4c61f1043a54ef"
server_key_iv: "a72e9f36c663cc57f944bada32fdab9c"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.406127 7897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "77f98017cacb4dba88dab80c8248bcda"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "49575cc1b673e96aea4c61f1043a54ef"
server_key_iv: "a72e9f36c663cc57f944bada32fdab9c"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.410640 7897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:56:58.413552 7912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.414968 7897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:56:58.415141 7897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "77f98017cacb4dba88dab80c8248bcda"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "49575cc1b673e96aea4c61f1043a54ef"
server_key_iv: "a72e9f36c663cc57f944bada32fdab9c"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.415288 7897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:56:58.449786 7897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:56:58.453392 7897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:56:58.453639 7897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:56:58.454321 7897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:56:58.455274 7897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:56:58.455350 7897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.455423 7897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:56:58.455479 7897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.467963 7897 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:35831
I20260806 16:56:58.468032 8032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:35831 every 8 connection(s)
I20260806 16:56:58.469169 7897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:56:58.472354 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 7897
I20260806 16:56:58.472577 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:56:58.472949 7780 external_mini_cluster.cc:1428] Setting key 637d76eb9c59c340c0664bdb2e107ec5
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:56:58.486928 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.471236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:34773 (local address 127.7.153.62:43195)
0806 16:56:58.471433 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 16:56:58.471437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:56:58.472393 (+ 956us) server_negotiation.cc:407] Connection header received
0806 16:56:58.474318 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:56:58.474321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:56:58.474390 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:56:58.474513 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:56:58.476488 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.477148 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.478569 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.479014 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.479146 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.482465 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:56:58.482472 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:56:58.482477 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:56:58.482524 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:56:58.484426 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:58.485174 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:58.485179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:58.485182 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:58.485289 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:58.485672 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:58.485675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:58.485677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:58.485968 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:56:58.486082 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:56:58.486669 (+ 587us) server_negotiation.cc:299] Negotiation successful
0806 16:56:58.486794 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 16:56:58.487852 8035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.471649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:43195 (local address 127.7.153.1:34773)
0806 16:56:58.472207 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0806 16:56:58.472277 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 16:56:58.474024 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:56:58.474724 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:56:58.474732 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:56:58.475285 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:56:58.476271 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:56:58.476297 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.477312 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.477318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:56:58.478421 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:56:58.478432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.479188 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.479191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:56:58.479363 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.480126 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:56:58.480144 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:56:58.482231 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:56:58.484598 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:56:58.484609 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:56:58.484651 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:56:58.485048 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:56:58.485402 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:56:58.485404 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:56:58.485406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:56:58.485555 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:56:58.486109 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:56:58.486115 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:56:58.486405 (+ 290us) client_negotiation.cc:769] Sending connection context
0806 16:56:58.486576 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 16:56:58.486881 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":134,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:56:58.489444 8033 heartbeater.cc:347] Connected to a master server at 127.7.153.62:43195
I20260806 16:56:58.489739 8033 heartbeater.cc:464] Registering TS with master...
I20260806 16:56:58.490312 8033 heartbeater.cc:511] Master 127.7.153.62:43195 requested a full tablet report, sending...
I20260806 16:56:58.492013 7835 ts_manager.cc:194] Registered new tserver with Master: 77f98017cacb4dba88dab80c8248bcda (127.7.153.1:35831)
I20260806 16:56:58.493274 7835 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:34773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:56:58.507977 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:43195
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:56:58.638818 8038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:56:58.639160 8038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:56:58.639209 8038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:56:58.643635 8038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:56:58.643733 8038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:56:58.643798 8038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:56:58.649820 8038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:43195
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:56:58.651121 8038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:56:58.652240 8038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:56:58.663206 8047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:56:58.663223 8045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:56:58.663383 8038 server_base.cc:1034] running on GCE node
W20260806 16:56:58.663228 8044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:56:58.664011 8038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:56:58.664893 8038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:56:58.666080 8038 hybrid_clock.cc:648] HybridClock initialized: now 1786035418666057 us; error 35 us; skew 500 ppm
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:56:58.669211 8038 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:56:58.670253 8038 webserver.cc:460] Webserver started at http://127.7.153.2:34495/ using document root <none> and password file <none>
I20260806 16:56:58.670917 8038 fs_manager.cc:359] Metadata directory not provided
I20260806 16:56:58.670992 8038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:56:58.671265 8038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:56:58.673857 8038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "4e8de7f8bf194b58821d9927b5e976d3"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "8717db458cab0672b705569700dd4a51"
server_key_iv: "d8381741a25442da44df702d37efe481"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.674575 8038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "4e8de7f8bf194b58821d9927b5e976d3"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "8717db458cab0672b705569700dd4a51"
server_key_iv: "d8381741a25442da44df702d37efe481"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.679301 8038 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260806 16:56:58.682255 8054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.683645 8038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:56:58.683794 8038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "4e8de7f8bf194b58821d9927b5e976d3"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "8717db458cab0672b705569700dd4a51"
server_key_iv: "d8381741a25442da44df702d37efe481"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.683923 8038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:56:58.707753 8038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:56:58.712201 8038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:56:58.712456 8038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:56:58.713305 8038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:56:58.714279 8038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:56:58.714334 8038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.714377 8038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:56:58.714399 8038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.727289 8038 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:40335
I20260806 16:56:58.727329 8173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:40335 every 8 connection(s)
I20260806 16:56:58.728385 8038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:56:58.737200 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8038
I20260806 16:56:58.737344 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:56:58.737624 7780 external_mini_cluster.cc:1428] Setting key ad3df16fa6812c589d2f7cbd2af7607b
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:56:58.745712 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.730626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:38285 (local address 127.7.153.62:43195)
0806 16:56:58.730821 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 16:56:58.730825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:56:58.732113 (+ 1288us) server_negotiation.cc:407] Connection header received
0806 16:56:58.733500 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:56:58.733503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:56:58.733558 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:56:58.733644 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:56:58.735157 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.735756 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.737350 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.737684 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.737836 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.741429 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:56:58.741432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:56:58.741434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:56:58.741463 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:56:58.742998 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:58.743611 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:58.743614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:58.743615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:58.743705 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:58.744096 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:58.744102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:58.744103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:58.744388 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:56:58.744502 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:56:58.745434 (+ 932us) server_negotiation.cc:299] Negotiation successful
0806 16:56:58.745573 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 16:56:58.747514 8176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.730978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:43195 (local address 127.7.153.2:38285)
0806 16:56:58.731906 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0806 16:56:58.731961 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 16:56:58.733273 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:56:58.733839 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:56:58.733847 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:56:58.734248 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:56:58.734954 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:56:58.734972 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.735903 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.735907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:56:58.737092 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:56:58.737107 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.737909 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.737914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:56:58.738256 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.739084 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:56:58.739105 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:56:58.741219 (+ 2114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:56:58.743149 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:56:58.743156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:56:58.743178 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:56:58.743482 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:56:58.743808 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:56:58.743811 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:56:58.743814 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:56:58.743983 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:56:58.744554 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:56:58.744584 (+ 30us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:56:58.745025 (+ 441us) client_negotiation.cc:769] Sending connection context
0806 16:56:58.745303 (+ 278us) client_negotiation.cc:240] Negotiation successful
0806 16:56:58.745762 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":136,"threads_started":1}
I20260806 16:56:58.749131 8174 heartbeater.cc:347] Connected to a master server at 127.7.153.62:43195
I20260806 16:56:58.749483 8174 heartbeater.cc:464] Registering TS with master...
I20260806 16:56:58.750383 8174 heartbeater.cc:511] Master 127.7.153.62:43195 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:56:58.751768 7835 ts_manager.cc:194] Registered new tserver with Master: 4e8de7f8bf194b58821d9927b5e976d3 (127.7.153.2:40335)
I20260806 16:56:58.752450 7835 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:38285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:56:58.773128 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:43195
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:56:58.905905 8179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:56:58.906242 8179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:56:58.906292 8179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:56:58.910769 8179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:56:58.910854 8179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:56:58.910923 8179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:56:58.916975 8179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:43195
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:56:58.918195 8179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:56:58.919330 8179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:56:58.930188 8185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:56:58.930202 8187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:56:58.930188 8184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:56:58.930331 8179 server_base.cc:1034] running on GCE node
I20260806 16:56:58.930948 8179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:56:58.931672 8179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:56:58.932861 8179 hybrid_clock.cc:648] HybridClock initialized: now 1786035418932823 us; error 52 us; skew 500 ppm
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:56:58.936022 8179 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:56:58.937273 8179 webserver.cc:460] Webserver started at http://127.7.153.3:36159/ using document root <none> and password file <none>
I20260806 16:56:58.937927 8179 fs_manager.cc:359] Metadata directory not provided
I20260806 16:56:58.938021 8179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:56:58.938282 8179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:56:58.940747 8179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "e5671582d9484150b24d1bf502739246"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "82807c785f032d58c28c55703746fa0e"
server_key_iv: "fec613639acceb395a3d2f4914151636"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.941478 8179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "e5671582d9484150b24d1bf502739246"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "82807c785f032d58c28c55703746fa0e"
server_key_iv: "fec613639acceb395a3d2f4914151636"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.946099 8179 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:56:58.948992 8194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.950316 8179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:56:58.950474 8179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "e5671582d9484150b24d1bf502739246"
format_stamp: "Formatted at 2026-08-06 16:56:58 on dist-test-slave-cbsf"
server_key: "82807c785f032d58c28c55703746fa0e"
server_key_iv: "fec613639acceb395a3d2f4914151636"
server_key_version: "encryptionkey@0"
I20260806 16:56:58.950608 8179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:56:58.966929 8179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:56:58.970727 8179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:56:58.970949 8179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:56:58.971611 8179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:56:58.972579 8179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:56:58.972648 8179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.972748 8179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:56:58.972798 8179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:56:58.985333 8179 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:33887
I20260806 16:56:58.985355 8315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:33887 every 8 connection(s)
I20260806 16:56:58.986485 8179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:56:58.992949 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8179
I20260806 16:56:58.993108 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:56:58.993448 7780 external_mini_cluster.cc:1428] Setting key a8aa565275290772e8a67f5a1d6cd024
Aug 06 16:56:58 dist-test-slave-cbsf krb5kdc[7788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035418, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:56:59.003221 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.988659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:34129 (local address 127.7.153.62:43195)
0806 16:56:58.988871 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 16:56:58.988883 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:56:58.989802 (+ 919us) server_negotiation.cc:407] Connection header received
0806 16:56:58.991268 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:56:58.991271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:56:58.991335 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:56:58.991419 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:56:58.992680 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.993353 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.994941 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.995325 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.995442 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.999267 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:56:58.999271 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:56:58.999274 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:56:58.999307 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:56:59.001090 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:59.001658 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:59.001661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:59.001662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:59.001739 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:59.002087 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:59.002089 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:59.002091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:59.002285 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:56:59.002362 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 16:56:59.002947 (+ 585us) server_negotiation.cc:299] Negotiation successful
0806 16:56:59.003089 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 16:56:59.004235 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:58.989125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:43195 (local address 127.7.153.3:34129)
0806 16:56:58.989626 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0806 16:56:58.989686 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 16:56:58.991039 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:56:58.991613 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:56:58.991621 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:56:58.992002 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:56:58.992522 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:56:58.992536 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.993491 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.993496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:56:58.994721 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:56:58.994738 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:56:58.995494 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:56:58.995498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:56:58.995802 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:58.996653 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:56:58.996676 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:56:58.999025 (+ 2349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:56:59.001220 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:56:59.001227 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:56:59.001245 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:56:59.001560 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:56:59.001823 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:56:59.001826 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:56:59.001827 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:56:59.001991 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:56:59.002375 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:56:59.002381 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:56:59.002723 (+ 342us) client_negotiation.cc:769] Sending connection context
0806 16:56:59.002900 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 16:56:59.003196 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":126,"threads_started":1}
I20260806 16:56:59.005705 8316 heartbeater.cc:347] Connected to a master server at 127.7.153.62:43195
I20260806 16:56:59.005993 8316 heartbeater.cc:464] Registering TS with master...
I20260806 16:56:59.006568 8316 heartbeater.cc:511] Master 127.7.153.62:43195 requested a full tablet report, sending...
I20260806 16:56:59.007912 7835 ts_manager.cc:194] Registered new tserver with Master: e5671582d9484150b24d1bf502739246 (127.7.153.3:33887)
I20260806 16:56:59.008806 7835 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:34129
I20260806 16:56:59.009109 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[7788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035419, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:56:59.042250 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:59.030384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54882 (local address 127.7.153.1:35831)
0806 16:56:59.030718 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0806 16:56:59.030727 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:56:59.030890 (+ 163us) server_negotiation.cc:407] Connection header received
0806 16:56:59.031066 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:56:59.031073 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:56:59.031297 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:56:59.031438 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:56:59.032309 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:59.033268 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:59.034547 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:59.035219 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:59.035327 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:59.038307 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:56:59.038321 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:56:59.038340 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:56:59.038371 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:56:59.040277 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:59.040941 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:59.040947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:59.040948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:59.041037 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:59.041302 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:59.041304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:59.041305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:59.041572 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:56:59.041748 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 16:56:59.041942 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 16:56:59.042106 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":147,"threads_started":1}
W20260806 16:56:59.043448 7943 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54882
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[7788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[7788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:56:59.073843 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:56:59.064489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.7.153.1:35831)
0806 16:56:59.064665 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 16:56:59.064669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:56:59.064941 (+ 272us) server_negotiation.cc:407] Connection header received
0806 16:56:59.065146 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:56:59.065149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:56:59.065200 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:56:59.065280 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:56:59.066080 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:59.066603 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:59.067535 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:56:59.067774 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:56:59.067868 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:56:59.070584 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:56:59.070588 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:56:59.070590 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:56:59.070619 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:56:59.071983 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:59.072479 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:59.072487 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:59.072488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:59.072568 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:56:59.072908 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:56:59.072911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:56:59.072913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:56:59.073113 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:56:59.073296 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 16:56:59.073531 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 16:56:59.073664 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 16:56:59.074931 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 7897
I20260806 16:56:59.083722 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8038
I20260806 16:56:59.091717 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8179
I20260806 16:56:59.102056 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 7803
2026-08-06T16:56:59Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2464 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[8330](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[8330](info): set up 2 sockets
Aug 06 16:56:59 dist-test-slave-cbsf krb5kdc[8330](info): commencing operation
krb5kdc: starting...
W20260806 16:57:00.201143 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:00 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:00.349167 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44207
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:44207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:00.477206 8344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:00.477705 8344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:00.477800 8344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:00.482371 8344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:00.482504 8344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:00.482542 8344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:00.482584 8344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:00.482640 8344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:00.488824 8344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:44207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:00.490139 8344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:00.491297 8344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:00.501976 8350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:00.502410 8352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:00.502023 8349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:00.502343 8344 server_base.cc:1034] running on GCE node
I20260806 16:57:00.503702 8344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:00.505194 8344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:00.506393 8344 hybrid_clock.cc:648] HybridClock initialized: now 1786035420506379 us; error 37 us; skew 500 ppm
Aug 06 16:57:00 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035420, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:00.510591 8344 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:00.511824 8344 webserver.cc:460] Webserver started at http://127.7.153.62:38371/ using document root <none> and password file <none>
I20260806 16:57:00.512534 8344 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:00.512626 8344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:00.513060 8344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:00.515764 8344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "35c3a00d9dea4d6ead13073e8ba549a1"
format_stamp: "Formatted at 2026-08-06 16:57:00 on dist-test-slave-cbsf"
server_key: "7028a346f8f6e6e2e88297fd923b6aa6"
server_key_iv: "5a9228bcf36425d3c2c0af2cffb2fe6f"
server_key_version: "encryptionkey@0"
I20260806 16:57:00.516594 8344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "35c3a00d9dea4d6ead13073e8ba549a1"
format_stamp: "Formatted at 2026-08-06 16:57:00 on dist-test-slave-cbsf"
server_key: "7028a346f8f6e6e2e88297fd923b6aa6"
server_key_iv: "5a9228bcf36425d3c2c0af2cffb2fe6f"
server_key_version: "encryptionkey@0"
I20260806 16:57:00.521881 8344 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 16:57:00.525344 8359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:00.526894 8344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 16:57:00.527081 8344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "35c3a00d9dea4d6ead13073e8ba549a1"
format_stamp: "Formatted at 2026-08-06 16:57:00 on dist-test-slave-cbsf"
server_key: "7028a346f8f6e6e2e88297fd923b6aa6"
server_key_iv: "5a9228bcf36425d3c2c0af2cffb2fe6f"
server_key_version: "encryptionkey@0"
I20260806 16:57:00.527232 8344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:00.567947 8344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:00.572218 8344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:00.572503 8344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:00.581059 8344 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:44207
I20260806 16:57:00.581103 8415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:44207 every 8 connection(s)
I20260806 16:57:00.582485 8344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:00.586663 8416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:00.589574 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8344
I20260806 16:57:00.589721 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:00.589998 7780 external_mini_cluster.cc:1428] Setting key 5a02896cd2dcccc8c2a8bdd7b811408c
I20260806 16:57:00.595889 8416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1: Bootstrap starting.
I20260806 16:57:00.598954 8416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:00.599848 8416 log.cc:824] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1: Log is configured to *not* fsync() on all Append() calls
Aug 06 16:57:00 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:00.602794 8416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1: No bootstrap required, opened a new log
I20260806 16:57:00.607942 8416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44207 } }
I20260806 16:57:00.608244 8416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:00.608282 8416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c3a00d9dea4d6ead13073e8ba549a1, State: Initialized, Role: FOLLOWER
I20260806 16:57:00.608325 8419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:00.591805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.7.153.62:44207)
0806 16:57:00.592392 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:00.592409 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:00.592454 (+ 45us) server_negotiation.cc:407] Connection header received
0806 16:57:00.593432 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:00.593469 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:00.593905 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:00.594331 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:00.595463 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:00.596588 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:00.597924 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:00.598624 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:00.598844 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:00.602428 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:00.602435 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:00.602454 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:00.602491 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:00.604367 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:00.605010 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:00.605016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:00.605021 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:00.605149 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:00.605463 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:00.605466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:00.605468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:00.605954 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:00.606175 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:00.606498 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 16:57:00.607073 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":175,"threads_started":1}
I20260806 16:57:00.608945 8416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44207 } }
I20260806 16:57:00.609138 8416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:00.609243 8416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:00.609380 8416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:00.610597 8416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44207 } }
I20260806 16:57:00.611050 8416 leader_election.cc:302] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35c3a00d9dea4d6ead13073e8ba549a1; no voters:
I20260806 16:57:00.611552 8416 leader_election.cc:288] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:00.611724 8422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:00.612074 8422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [term 1 LEADER]: Becoming Leader. State: Replica: 35c3a00d9dea4d6ead13073e8ba549a1, State: Running, Role: LEADER
I20260806 16:57:00.612572 8422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44207 } }
I20260806 16:57:00.613610 8416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:00.615588 8424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35c3a00d9dea4d6ead13073e8ba549a1. Latest consensus state: current_term: 1 leader_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44207 } } }
I20260806 16:57:00.615808 8424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:00.616077 8423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35c3a00d9dea4d6ead13073e8ba549a1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44207 } } }
I20260806 16:57:00.616200 8423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:00.617007 8431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:00.621086 8431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:00.630745 8431 catalog_manager.cc:1347] Generated new cluster ID: 4c844f8adbc8464197be87c190fcea3b
I20260806 16:57:00.630867 8431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:00.636973 8431 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:00.638047 8431 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:00.656520 8431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35c3a00d9dea4d6ead13073e8ba549a1: Generated new TSK 0
I20260806 16:57:00.657467 8431 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:00.693953 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44207
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:00.825925 8444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:00.826241 8444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:00.826290 8444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:00.830716 8444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:00.830806 8444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:00.830873 8444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:00.836937 8444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44207
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:00.838171 8444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:00.839243 8444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:00.849998 8449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:00.850019 8450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:00.850026 8444 server_base.cc:1034] running on GCE node
W20260806 16:57:00.850052 8452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:00.850756 8444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:00.851490 8444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:00.852679 8444 hybrid_clock.cc:648] HybridClock initialized: now 1786035420852638 us; error 44 us; skew 500 ppm
Aug 06 16:57:00 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035420, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:00.856232 8444 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:00.857421 8444 webserver.cc:460] Webserver started at http://127.7.153.1:41211/ using document root <none> and password file <none>
I20260806 16:57:00.858104 8444 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:00.858211 8444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:00.858477 8444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:00.860879 8444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "9963763eebd642849a7321798c262a29"
format_stamp: "Formatted at 2026-08-06 16:57:00 on dist-test-slave-cbsf"
server_key: "790c494002b06da9b6c3815dbe6dcde1"
server_key_iv: "9c55cf5a54ece68b155dce080a86297e"
server_key_version: "encryptionkey@0"
I20260806 16:57:00.861620 8444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "9963763eebd642849a7321798c262a29"
format_stamp: "Formatted at 2026-08-06 16:57:00 on dist-test-slave-cbsf"
server_key: "790c494002b06da9b6c3815dbe6dcde1"
server_key_iv: "9c55cf5a54ece68b155dce080a86297e"
server_key_version: "encryptionkey@0"
I20260806 16:57:00.866706 8444 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 16:57:00.871039 8460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:00.872905 8444 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 16:57:00.873092 8444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "9963763eebd642849a7321798c262a29"
format_stamp: "Formatted at 2026-08-06 16:57:00 on dist-test-slave-cbsf"
server_key: "790c494002b06da9b6c3815dbe6dcde1"
server_key_iv: "9c55cf5a54ece68b155dce080a86297e"
server_key_version: "encryptionkey@0"
I20260806 16:57:00.873255 8444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:00.893736 8444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:00.898006 8444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:00.898240 8444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:00.898943 8444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:00.899968 8444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:00.900048 8444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:00.900125 8444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:00.900179 8444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:00.911341 8444 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:37785
I20260806 16:57:00.911365 8576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:37785 every 8 connection(s)
I20260806 16:57:00.912421 8444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:00.913120 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8444
I20260806 16:57:00.913257 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:00.913668 7780 external_mini_cluster.cc:1428] Setting key 5326636a289a47839ce9ab779447e7cb
Aug 06 16:57:00 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035420, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:00.930687 8419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:00.914732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:53577 (local address 127.7.153.62:44207)
0806 16:57:00.914890 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:00.914894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:00.916050 (+ 1156us) server_negotiation.cc:407] Connection header received
0806 16:57:00.917735 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:00.917738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:00.917788 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:00.917861 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:00.919703 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:00.920293 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:00.922431 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:00.922715 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:00.922827 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:00.926211 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:00.926216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:00.926219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:00.926253 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:00.927856 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:00.928570 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:00.928576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:00.928580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:00.928679 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:00.929237 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:00.929240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:00.929241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:00.929461 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:00.929547 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:00.930396 (+ 849us) server_negotiation.cc:299] Negotiation successful
0806 16:57:00.930533 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:57:00.931802 8579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:00.915329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44207 (local address 127.7.153.1:53577)
0806 16:57:00.915852 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:00.915911 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:00.917422 (+ 1511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:00.918084 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:00.918098 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:00.918692 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:00.919495 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:00.919521 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:00.920461 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:00.920468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:00.922240 (+ 1772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:00.922259 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:00.922926 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:00.922933 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:00.923227 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:00.923975 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:00.924003 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:00.925978 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:00.928014 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:00.928022 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:00.928046 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:00.928403 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:00.928865 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:00.928868 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:00.928869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:00.929049 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:00.929587 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:00.929597 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:00.930048 (+ 451us) client_negotiation.cc:769] Sending connection context
0806 16:57:00.930316 (+ 268us) client_negotiation.cc:240] Negotiation successful
0806 16:57:00.930770 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":158,"threads_started":1}
I20260806 16:57:00.933301 8577 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44207
I20260806 16:57:00.933609 8577 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:00.934345 8577 heartbeater.cc:511] Master 127.7.153.62:44207 requested a full tablet report, sending...
I20260806 16:57:00.936599 8372 ts_manager.cc:194] Registered new tserver with Master: 9963763eebd642849a7321798c262a29 (127.7.153.1:37785)
I20260806 16:57:00.938071 8372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:53577
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:00.948292 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44207
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:01.076056 8582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:01.076359 8582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:01.076407 8582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:01.080946 8582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:01.081032 8582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:01.081099 8582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:01.086992 8582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44207
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:01.088156 8582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:01.089257 8582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:01.100026 8589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:01.100024 8587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:01.100220 8582 server_base.cc:1034] running on GCE node
W20260806 16:57:01.100045 8591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:01.100889 8582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:01.101648 8582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:01.102823 8582 hybrid_clock.cc:648] HybridClock initialized: now 1786035421102804 us; error 34 us; skew 500 ppm
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:01.106125 8582 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:01.107074 8582 webserver.cc:460] Webserver started at http://127.7.153.2:44485/ using document root <none> and password file <none>
I20260806 16:57:01.107712 8582 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:01.107780 8582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:01.108017 8582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:01.110366 8582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "968d1bd01b2047a49891c7d9fdaa966e"
format_stamp: "Formatted at 2026-08-06 16:57:01 on dist-test-slave-cbsf"
server_key: "55d5c54b1b6437213c8d3d6e585dd1f0"
server_key_iv: "5a02f951fa3038afcdb0e6906ce7a730"
server_key_version: "encryptionkey@0"
I20260806 16:57:01.110999 8582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "968d1bd01b2047a49891c7d9fdaa966e"
format_stamp: "Formatted at 2026-08-06 16:57:01 on dist-test-slave-cbsf"
server_key: "55d5c54b1b6437213c8d3d6e585dd1f0"
server_key_iv: "5a02f951fa3038afcdb0e6906ce7a730"
server_key_version: "encryptionkey@0"
I20260806 16:57:01.115989 8582 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 16:57:01.119062 8599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:01.120594 8582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:01.120808 8582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "968d1bd01b2047a49891c7d9fdaa966e"
format_stamp: "Formatted at 2026-08-06 16:57:01 on dist-test-slave-cbsf"
server_key: "55d5c54b1b6437213c8d3d6e585dd1f0"
server_key_iv: "5a02f951fa3038afcdb0e6906ce7a730"
server_key_version: "encryptionkey@0"
I20260806 16:57:01.120952 8582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:01.154377 8582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:01.158211 8582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:01.158478 8582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:01.159153 8582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:01.160084 8582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:01.160164 8582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:01.160238 8582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:01.160282 8582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:01.170532 8582 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:33309
I20260806 16:57:01.170555 8717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:33309 every 8 connection(s)
I20260806 16:57:01.171551 8582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:01.177511 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8582
I20260806 16:57:01.177654 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:01.177945 7780 external_mini_cluster.cc:1428] Setting key 7fffef61314e1d0b16a717447277fbda
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:01.188414 8419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.173593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:33563 (local address 127.7.153.62:44207)
0806 16:57:01.173777 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.173782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.174679 (+ 897us) server_negotiation.cc:407] Connection header received
0806 16:57:01.176070 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.176074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.176124 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.176205 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:01.177837 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.178659 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.180087 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.180346 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.180480 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.183895 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:01.183902 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:01.183909 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:01.183947 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:01.185872 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.186466 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.186472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.186476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.186584 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.186959 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.186966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.186969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.187287 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:01.187410 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.188011 (+ 601us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.188186 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 16:57:01.189282 8720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.174009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44207 (local address 127.7.153.2:33563)
0806 16:57:01.174507 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.174553 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.175842 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.176391 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.176399 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.176874 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:01.177578 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.177601 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.178828 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.178837 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.179936 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.179947 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.180543 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.180549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.180819 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.181568 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:01.181603 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:01.183545 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:01.186015 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:01.186021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:01.186038 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:01.186348 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:01.186691 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:01.186693 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:01.186695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:01.186853 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:01.187416 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:01.187423 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:01.187735 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.187919 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.188226 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:57:01.190670 8718 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44207
I20260806 16:57:01.190954 8718 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:01.191475 8718 heartbeater.cc:511] Master 127.7.153.62:44207 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:01.192837 8372 ts_manager.cc:194] Registered new tserver with Master: 968d1bd01b2047a49891c7d9fdaa966e (127.7.153.2:33309)
I20260806 16:57:01.193714 8372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:33563
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:01.212543 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44207
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:45165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:01.337301 8723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:01.337620 8723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:01.337669 8723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:01.341965 8723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:01.342042 8723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:01.342144 8723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:01.348490 8723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:45165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44207
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:01.349828 8723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:01.350937 8723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:01.361577 8728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:01.361595 8731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:01.361577 8729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:01.361718 8723 server_base.cc:1034] running on GCE node
I20260806 16:57:01.362426 8723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:01.363188 8723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:01.364395 8723 hybrid_clock.cc:648] HybridClock initialized: now 1786035421364379 us; error 30 us; skew 500 ppm
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:01.372107 8723 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:01.373310 8723 webserver.cc:460] Webserver started at http://127.7.153.3:42229/ using document root <none> and password file <none>
I20260806 16:57:01.373943 8723 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:01.374038 8723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:01.374298 8723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:01.376566 8723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "2b9daa0734da4ed08a32353fc2672f22"
format_stamp: "Formatted at 2026-08-06 16:57:01 on dist-test-slave-cbsf"
server_key: "b4ad5edc750cb92af0a6a6ddf0eecdbb"
server_key_iv: "240a4ba380ea042505a27c914f09d838"
server_key_version: "encryptionkey@0"
I20260806 16:57:01.377336 8723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "2b9daa0734da4ed08a32353fc2672f22"
format_stamp: "Formatted at 2026-08-06 16:57:01 on dist-test-slave-cbsf"
server_key: "b4ad5edc750cb92af0a6a6ddf0eecdbb"
server_key_iv: "240a4ba380ea042505a27c914f09d838"
server_key_version: "encryptionkey@0"
I20260806 16:57:01.381752 8723 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:01.384967 8739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:01.386454 8723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:01.386648 8723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "2b9daa0734da4ed08a32353fc2672f22"
format_stamp: "Formatted at 2026-08-06 16:57:01 on dist-test-slave-cbsf"
server_key: "b4ad5edc750cb92af0a6a6ddf0eecdbb"
server_key_iv: "240a4ba380ea042505a27c914f09d838"
server_key_version: "encryptionkey@0"
I20260806 16:57:01.386788 8723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:01.400061 8723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:01.403816 8723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:01.404055 8723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:01.404767 8723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:01.405673 8723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:01.405748 8723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:01.405820 8723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:01.405864 8723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:01.418411 8723 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:37405
I20260806 16:57:01.418450 8855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:37405 every 8 connection(s)
I20260806 16:57:01.419457 8723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:01.421831 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8723
I20260806 16:57:01.421968 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:01.422405 7780 external_mini_cluster.cc:1428] Setting key 9e8774f65f269300da8c8cf7dac4e791
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:01.436548 8419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.421726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:36203 (local address 127.7.153.62:44207)
0806 16:57:01.421896 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.421921 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.423298 (+ 1377us) server_negotiation.cc:407] Connection header received
0806 16:57:01.425286 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.425288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.425337 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.425406 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:01.426816 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.427383 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.428799 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.429039 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.429127 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.432318 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:01.432321 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:01.432324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:01.432355 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:01.434087 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.434730 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.434734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.434735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.434826 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.435235 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.435238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.435240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.435458 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:01.435574 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.436236 (+ 662us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.436377 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 16:57:01.437588 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.422432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44207 (local address 127.7.153.3:36203)
0806 16:57:01.423109 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.423168 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.425032 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.425603 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.425611 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.426094 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:01.426643 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.426659 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.427533 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.427535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.428589 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.428600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.429203 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.429206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.429366 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.430056 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:01.430074 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:01.432096 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:01.434253 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:01.434261 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:01.434291 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:01.434600 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:01.434938 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:01.434942 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:01.434944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:01.435110 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:01.435574 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:01.435584 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:01.435934 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.436195 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.436582 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":176,"threads_started":1}
I20260806 16:57:01.438918 8856 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44207
I20260806 16:57:01.439236 8856 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:01.439831 8856 heartbeater.cc:511] Master 127.7.153.62:44207 requested a full tablet report, sending...
I20260806 16:57:01.441458 8372 ts_manager.cc:194] Registered new tserver with Master: 2b9daa0734da4ed08a32353fc2672f22 (127.7.153.3:37405)
I20260806 16:57:01.442504 8372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:36203
I20260806 16:57:01.449839 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:57:01.463354 8419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.454895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.7.153.62:44207)
0806 16:57:01.455120 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.455125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.455286 (+ 161us) server_negotiation.cc:407] Connection header received
0806 16:57:01.455477 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.455485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.455530 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.455635 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:01.456450 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.457078 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.457996 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.458286 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.458397 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.460004 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:01.460007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:01.460009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:01.460037 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:01.461506 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.461978 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.461981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.461982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.462062 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.462359 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.462363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.462364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.462626 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:01.462780 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.463034 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.463169 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 16:57:01.470168 8372 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:01.473552 8372 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:01.491385 8871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.484889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:37405 (local address 127.0.0.1:58926)
0806 16:57:01.485701 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.485714 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.485811 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.486313 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.486316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.486333 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.486430 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.486436 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.487844 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.487847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.489495 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.489501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.490590 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.490594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.490800 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.490844 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.491104 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.491177 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":226,"thread_start_us":95,"threads_started":1}
I20260806 16:57:01.491947 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.485319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58926 (local address 127.7.153.3:37405)
0806 16:57:01.485664 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.485676 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.485818 (+ 142us) server_negotiation.cc:407] Connection header received
0806 16:57:01.485918 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.485923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.486094 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.486236 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.486556 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.487690 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.489632 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.490450 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.490554 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.490684 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.491642 (+ 958us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.491762 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":113,"threads_started":1}
I20260806 16:57:01.491988 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.484941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40364 (local address 127.7.153.2:33309)
0806 16:57:01.485525 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.485538 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.485561 (+ 23us) server_negotiation.cc:407] Connection header received
0806 16:57:01.485657 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.485663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.485857 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.486045 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.486335 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.487606 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.489372 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.490304 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.490438 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.491513 (+ 1075us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.491581 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.491699 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":136,"threads_started":1}
I20260806 16:57:01.491385 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.484400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:33309 (local address 127.0.0.1:40364)
0806 16:57:01.485168 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.485181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.485264 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.486012 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.486015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.486033 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.486189 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.486200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.487847 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.487850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.489228 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.489241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.490475 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.490479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.490762 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.490888 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.490983 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.491163 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":223,"thread_start_us":115,"threads_started":1}
I20260806 16:57:01.492901 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.484208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44514 (local address 127.7.153.1:37785)
0806 16:57:01.485354 (+ 1146us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.485361 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.485381 (+ 20us) server_negotiation.cc:407] Connection header received
0806 16:57:01.485446 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.485450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.485700 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.486123 (+ 423us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.486404 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.487606 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.490768 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.491763 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.492451 (+ 688us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.492597 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.492643 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.492787 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1036,"thread_start_us":118,"threads_started":1}
I20260806 16:57:01.492343 8868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.484015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37785 (local address 127.0.0.1:44514)
0806 16:57:01.484742 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.484800 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.484933 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.485911 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.485918 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.485945 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.486272 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.486280 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.487796 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.487801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.489467 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.489480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.491911 (+ 2431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.491915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.492021 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.492049 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.492108 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.492198 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":255,"thread_start_us":147,"threads_started":1}
I20260806 16:57:01.495939 8648 tablet_service.cc:1467] Processing CreateTablet for tablet 878bf0f28372434db7fb27e5e3686d32 (DEFAULT_TABLE table=test-table [id=d817aeecfc164ea59c6f5aae658f2b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:01.496042 8508 tablet_service.cc:1467] Processing CreateTablet for tablet 878bf0f28372434db7fb27e5e3686d32 (DEFAULT_TABLE table=test-table [id=d817aeecfc164ea59c6f5aae658f2b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:01.497354 8508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 878bf0f28372434db7fb27e5e3686d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:01.498673 8789 tablet_service.cc:1467] Processing CreateTablet for tablet 878bf0f28372434db7fb27e5e3686d32 (DEFAULT_TABLE table=test-table [id=d817aeecfc164ea59c6f5aae658f2b56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:01.499689 8789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 878bf0f28372434db7fb27e5e3686d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:01.499788 8648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 878bf0f28372434db7fb27e5e3686d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:01.505479 8874 tablet_bootstrap.cc:492] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: Bootstrap starting.
I20260806 16:57:01.507272 8875 tablet_bootstrap.cc:492] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: Bootstrap starting.
I20260806 16:57:01.509094 8877 tablet_bootstrap.cc:492] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: Bootstrap starting.
I20260806 16:57:01.509433 8874 tablet_bootstrap.cc:654] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:01.509469 8875 tablet_bootstrap.cc:654] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:01.510309 8874 log.cc:824] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:01.510986 8875 log.cc:824] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:01.512324 8877 tablet_bootstrap.cc:654] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:01.512516 8874 tablet_bootstrap.cc:492] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: No bootstrap required, opened a new log
I20260806 16:57:01.512811 8874 ts_tablet_manager.cc:1397] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 16:57:01.513348 8875 tablet_bootstrap.cc:492] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: No bootstrap required, opened a new log
I20260806 16:57:01.513334 8877 log.cc:824] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:01.513543 8875 ts_tablet_manager.cc:1397] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260806 16:57:01.516746 8877 tablet_bootstrap.cc:492] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: No bootstrap required, opened a new log
I20260806 16:57:01.516983 8877 ts_tablet_manager.cc:1397] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 16:57:01.517617 8874 raft_consensus.cc:348] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.517643 8875 raft_consensus.cc:348] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.517916 8874 raft_consensus.cc:374] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:01.517927 8875 raft_consensus.cc:374] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:01.517972 8874 raft_consensus.cc:729] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9963763eebd642849a7321798c262a29, State: Initialized, Role: FOLLOWER
I20260806 16:57:01.517984 8875 raft_consensus.cc:729] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b9daa0734da4ed08a32353fc2672f22, State: Initialized, Role: FOLLOWER
I20260806 16:57:01.518462 8874 consensus_queue.cc:260] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.518487 8875 consensus_queue.cc:260] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.519317 8577 heartbeater.cc:503] Master 127.7.153.62:44207 was elected leader, sending a full tablet report...
I20260806 16:57:01.519680 8874 ts_tablet_manager.cc:1428] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 16:57:01.519913 8856 heartbeater.cc:503] Master 127.7.153.62:44207 was elected leader, sending a full tablet report...
I20260806 16:57:01.521557 8877 raft_consensus.cc:348] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.521888 8877 raft_consensus.cc:374] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:01.521943 8877 raft_consensus.cc:729] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 968d1bd01b2047a49891c7d9fdaa966e, State: Initialized, Role: FOLLOWER
I20260806 16:57:01.522289 8875 ts_tablet_manager.cc:1428] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260806 16:57:01.522465 8877 consensus_queue.cc:260] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.523284 8718 heartbeater.cc:503] Master 127.7.153.62:44207 was elected leader, sending a full tablet report...
I20260806 16:57:01.523618 8877 ts_tablet_manager.cc:1428] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 16:57:01.622188 8882 raft_consensus.cc:482] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:01.622426 8882 raft_consensus.cc:504] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.623652 8882 leader_election.cc:288] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9963763eebd642849a7321798c262a29 (127.7.153.1:37785), 968d1bd01b2047a49891c7d9fdaa966e (127.7.153.2:33309)
I20260806 16:57:01.625509 8881 raft_consensus.cc:482] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:01.625734 8881 raft_consensus.cc:504] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.627159 8881 leader_election.cc:288] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b9daa0734da4ed08a32353fc2672f22 (127.7.153.3:37405), 968d1bd01b2047a49891c7d9fdaa966e (127.7.153.2:33309)
I20260806 16:57:01.628492 8858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.623967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:33309 (local address 127.7.153.3:58285)
0806 16:57:01.624103 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.624120 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.624246 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.624545 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.624549 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.624570 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.624770 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.624783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.625829 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.625833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.626899 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.626910 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.628025 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.628029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.628159 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.628185 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.628258 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.628336 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 16:57:01.628916 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.624078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:58285 (local address 127.7.153.2:33309)
0806 16:57:01.624228 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.624233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.624252 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:01.624346 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.624350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.624415 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.624511 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.624917 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.625679 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.627043 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.627705 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.627828 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.627901 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.628679 (+ 778us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.628783 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 16:57:01.629611 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.623967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37785 (local address 127.7.153.3:57657)
0806 16:57:01.624763 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.624777 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.624883 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.625132 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.625134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.625159 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.625322 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.625328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.626400 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.626406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.627550 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.627565 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.629167 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.629170 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.629290 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.629314 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.629388 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.629462 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":321,"thread_start_us":129,"threads_started":1}
I20260806 16:57:01.629664 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.624145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:57657 (local address 127.7.153.1:37785)
0806 16:57:01.624272 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.624278 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.624880 (+ 602us) server_negotiation.cc:407] Connection header received
0806 16:57:01.624969 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.624972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.625028 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.625120 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.625452 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.626264 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.627705 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.628324 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.628401 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.628465 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.629410 (+ 945us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.629540 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":55}
I20260806 16:57:01.629577 8669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878bf0f28372434db7fb27e5e3686d32" candidate_uuid: "2b9daa0734da4ed08a32353fc2672f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "968d1bd01b2047a49891c7d9fdaa966e" is_pre_election: true
I20260806 16:57:01.629967 8669 raft_consensus.cc:2454] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9daa0734da4ed08a32353fc2672f22 in term 0.
I20260806 16:57:01.630339 8530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878bf0f28372434db7fb27e5e3686d32" candidate_uuid: "2b9daa0734da4ed08a32353fc2672f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9963763eebd642849a7321798c262a29" is_pre_election: true
I20260806 16:57:01.630599 8530 raft_consensus.cc:2454] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b9daa0734da4ed08a32353fc2672f22 in term 0.
I20260806 16:57:01.630569 8743 leader_election.cc:302] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9daa0734da4ed08a32353fc2672f22, 968d1bd01b2047a49891c7d9fdaa966e; no voters:
I20260806 16:57:01.630903 8882 raft_consensus.cc:2781] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:01.630982 8882 raft_consensus.cc:482] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:01.631029 8882 raft_consensus.cc:3037] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:01.632347 8882 raft_consensus.cc:504] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.632812 8882 leader_election.cc:288] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [CANDIDATE]: Term 1 election: Requested vote from peers 9963763eebd642849a7321798c262a29 (127.7.153.1:37785), 968d1bd01b2047a49891c7d9fdaa966e (127.7.153.2:33309)
I20260806 16:57:01.633236 8530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878bf0f28372434db7fb27e5e3686d32" candidate_uuid: "2b9daa0734da4ed08a32353fc2672f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9963763eebd642849a7321798c262a29"
I20260806 16:57:01.633348 8669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878bf0f28372434db7fb27e5e3686d32" candidate_uuid: "2b9daa0734da4ed08a32353fc2672f22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "968d1bd01b2047a49891c7d9fdaa966e"
I20260806 16:57:01.633381 8530 raft_consensus.cc:3037] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:01.633502 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.628587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:51241 (local address 127.7.153.3:37405)
0806 16:57:01.629013 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.629018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.629046 (+ 28us) server_negotiation.cc:407] Connection header received
0806 16:57:01.629107 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.629110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.629165 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.629242 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.629692 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.630388 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.631996 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.632608 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.632762 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.632831 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.633291 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.633386 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260806 16:57:01.633474 8669 raft_consensus.cc:3037] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:01.634001 8886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.627375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:37405 (local address 127.7.153.1:51241)
0806 16:57:01.627929 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.627945 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.628043 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.629395 (+ 1352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.629398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.629415 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.629549 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.629556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.630509 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.630512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.631811 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.631822 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.632790 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.632794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.632979 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.633005 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.633078 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.633155 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":5,"thread_start_us":125,"threads_started":1}
I20260806 16:57:01.634442 8887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.627458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:33309 (local address 127.7.153.1:43001)
0806 16:57:01.628216 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:01.628231 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:01.628324 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:01.628591 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:01.628594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:01.628615 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:01.629164 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.629173 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.631527 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.631531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.632836 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:01.632845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.633969 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.633974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:01.634101 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.634130 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 16:57:01.634218 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 16:57:01.634300 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":149,"threads_started":1}
I20260806 16:57:01.635054 8530 raft_consensus.cc:2454] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9daa0734da4ed08a32353fc2672f22 in term 1.
I20260806 16:57:01.635066 8669 raft_consensus.cc:2454] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b9daa0734da4ed08a32353fc2672f22 in term 1.
I20260806 16:57:01.635535 8888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.627868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:43001 (local address 127.7.153.2:33309)
0806 16:57:01.628346 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.628359 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.628373 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:57:01.628415 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.628418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.628462 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.628556 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:01.630638 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.631388 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.632984 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.633738 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.633843 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.633909 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.634622 (+ 713us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.634995 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":123,"threads_started":1}
I20260806 16:57:01.635552 8741 leader_election.cc:302] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b9daa0734da4ed08a32353fc2672f22, 9963763eebd642849a7321798c262a29; no voters:
I20260806 16:57:01.635735 8882 raft_consensus.cc:2781] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:01.635769 8810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878bf0f28372434db7fb27e5e3686d32" candidate_uuid: "9963763eebd642849a7321798c262a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b9daa0734da4ed08a32353fc2672f22" is_pre_election: true
I20260806 16:57:01.635965 8882 raft_consensus.cc:686] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [term 1 LEADER]: Becoming Leader. State: Replica: 2b9daa0734da4ed08a32353fc2672f22, State: Running, Role: LEADER
I20260806 16:57:01.636343 8882 consensus_queue.cc:237] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } }
I20260806 16:57:01.636456 8669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "878bf0f28372434db7fb27e5e3686d32" candidate_uuid: "9963763eebd642849a7321798c262a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "968d1bd01b2047a49891c7d9fdaa966e" is_pre_election: true
I20260806 16:57:01.636669 8669 raft_consensus.cc:2379] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9963763eebd642849a7321798c262a29 in current term 1: Already voted for candidate 2b9daa0734da4ed08a32353fc2672f22 in this term.
I20260806 16:57:01.639477 8462 leader_election.cc:302] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9963763eebd642849a7321798c262a29; no voters: 2b9daa0734da4ed08a32353fc2672f22, 968d1bd01b2047a49891c7d9fdaa966e
I20260806 16:57:01.639822 8881 raft_consensus.cc:2726] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 16:57:01.640112 8375 catalog_manager.cc:5495] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b9daa0734da4ed08a32353fc2672f22 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "2b9daa0734da4ed08a32353fc2672f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9963763eebd642849a7321798c262a29" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b9daa0734da4ed08a32353fc2672f22" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "968d1bd01b2047a49891c7d9fdaa966e" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 33309 } health_report { overall_health: UNKNOWN } } }
W20260806 16:57:01.664135 8578 tablet.cc:2369] T 878bf0f28372434db7fb27e5e3686d32 P 9963763eebd642849a7321798c262a29: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:57:01.670630 8857 tablet.cc:2369] T 878bf0f28372434db7fb27e5e3686d32 P 2b9daa0734da4ed08a32353fc2672f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:57:01.672899 8719 tablet.cc:2369] T 878bf0f28372434db7fb27e5e3686d32 P 968d1bd01b2047a49891c7d9fdaa966e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:01.685875 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.676070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44526 (local address 127.7.153.1:37785)
0806 16:57:01.676253 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.676258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.676404 (+ 146us) server_negotiation.cc:407] Connection header received
0806 16:57:01.676571 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.676575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.676646 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.676779 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:01.677565 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.678165 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.679022 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.679263 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.679388 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.682139 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:01.682154 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:01.682173 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:01.682203 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:01.684092 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.684600 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.684605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.684607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.684735 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.685008 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.685010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.685012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.685282 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:01.685459 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.685642 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.685747 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:01.717979 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.707688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44538 (local address 127.7.153.1:37785)
0806 16:57:01.707889 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.707894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.708028 (+ 134us) server_negotiation.cc:407] Connection header received
0806 16:57:01.708213 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.708216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.708269 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.708360 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:01.709239 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.709912 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.710788 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.711042 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.711163 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.713959 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:01.713963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:01.713965 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:01.713994 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:01.715936 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.716495 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.716498 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.716500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.716605 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.716991 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.716994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.716995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.717214 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:01.717329 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.717633 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.717748 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8330](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035421, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:01.749822 8869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:01.740504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.7.153.1:37785)
0806 16:57:01.740665 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:01.740670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:01.740892 (+ 222us) server_negotiation.cc:407] Connection header received
0806 16:57:01.741070 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:01.741073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:01.741120 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:01.741214 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:01.742171 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.742702 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.743615 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:01.743834 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:01.743945 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:01.746657 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:01.746660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:01.746662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:01.746693 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:01.748005 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.748471 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.748475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.748476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.748553 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:01.748900 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:01.748904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:01.748905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:01.749113 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:01.749260 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:01.749507 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 16:57:01.749645 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 16:57:01.751618 8488 tablet_service.cc:2908] Rejecting scan request for tablet 878bf0f28372434db7fb27e5e3686d32: Uninitialized: clean time has not yet been initialized
I20260806 16:57:01.754120 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8444
I20260806 16:57:01.763360 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8582
I20260806 16:57:01.770939 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8723
I20260806 16:57:01.779443 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8344
2026-08-06T16:57:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2677 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8905](info): set up 2 sockets
Aug 06 16:57:01 dist-test-slave-cbsf krb5kdc[8905](info): commencing operation
krb5kdc: starting...
W20260806 16:57:02.861043 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:02 dist-test-slave-cbsf krb5kdc[8905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:03.008997 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42707
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:03.134296 8919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:03.134629 8919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:03.134673 8919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:03.139070 8919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:03.139154 8919 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 16:57:03.139173 8919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:03.139192 8919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:03.139209 8919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:03.139225 8919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:03.145175 8919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42707
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:03.146379 8919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:03.147535 8919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:03.157015 8924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:03.157015 8925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:03.157018 8927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:03.157075 8919 server_base.cc:1034] running on GCE node
I20260806 16:57:03.158152 8919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:03.159407 8919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:03.160581 8919 hybrid_clock.cc:648] HybridClock initialized: now 1786035423160550 us; error 48 us; skew 500 ppm
Aug 06 16:57:03 dist-test-slave-cbsf krb5kdc[8905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035423, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:03.163723 8919 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:03.164939 8919 webserver.cc:460] Webserver started at http://127.7.153.62:40123/ using document root <none> and password file <none>
I20260806 16:57:03.165611 8919 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:03.165719 8919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:03.165993 8919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:03.168429 8919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "f1f82afc59aa41268350df1c37749400"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "c73e7207647bc3643f398993750d360e"
server_key_iv: "ed13eda1fd4445cd16c166ffea4bf3b9"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.169198 8919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "f1f82afc59aa41268350df1c37749400"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "c73e7207647bc3643f398993750d360e"
server_key_iv: "ed13eda1fd4445cd16c166ffea4bf3b9"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.173756 8919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:03.176541 8934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:03.178109 8919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:03.178282 8919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "f1f82afc59aa41268350df1c37749400"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "c73e7207647bc3643f398993750d360e"
server_key_iv: "ed13eda1fd4445cd16c166ffea4bf3b9"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.178421 8919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:03.190598 8919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:03.194335 8919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:03.194572 8919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:03.203867 8919 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42707
I20260806 16:57:03.203946 9000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42707 every 8 connection(s)
I20260806 16:57:03.205011 8919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:03.207898 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 8919
I20260806 16:57:03.207999 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:03.208307 7780 external_mini_cluster.cc:1428] Setting key ed14582d4e51e94e1513a3b95f271c24
I20260806 16:57:03.208474 9001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:03.216964 9001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: Bootstrap starting.
Aug 06 16:57:03 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:03.220039 9001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:03.221091 9001 log.cc:824] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:03.223976 9001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: No bootstrap required, opened a new log
I20260806 16:57:03.226575 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.209937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53990 (local address 127.7.153.62:42707)
0806 16:57:03.210405 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:03.210424 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:03.210467 (+ 43us) server_negotiation.cc:407] Connection header received
0806 16:57:03.211246 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:03.211270 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:03.211737 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:03.212164 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:03.212962 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.214526 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.215491 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.216236 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.216410 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.219384 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:03.219391 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:03.219412 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:03.219451 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:03.222729 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.223688 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.223695 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.223702 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.223872 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.224280 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.224286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.224292 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.224899 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:03.225151 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:03.225447 (+ 296us) server_negotiation.cc:299] Negotiation successful
0806 16:57:03.225779 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":128,"threads_started":1}
I20260806 16:57:03.227674 9001 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f82afc59aa41268350df1c37749400" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42707 } }
I20260806 16:57:03.227993 9001 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:03.228045 9001 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f82afc59aa41268350df1c37749400, State: Initialized, Role: FOLLOWER
I20260806 16:57:03.228551 9001 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f82afc59aa41268350df1c37749400" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42707 } }
I20260806 16:57:03.228760 9001 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:03.228837 9001 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:03.228941 9001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:03.230013 9001 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f82afc59aa41268350df1c37749400" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42707 } }
I20260806 16:57:03.230387 9001 leader_election.cc:302] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1f82afc59aa41268350df1c37749400; no voters:
I20260806 16:57:03.230741 9001 leader_election.cc:288] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:03.230894 9006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:03.231163 9006 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [term 1 LEADER]: Becoming Leader. State: Replica: f1f82afc59aa41268350df1c37749400, State: Running, Role: LEADER
I20260806 16:57:03.231561 9006 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f82afc59aa41268350df1c37749400" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42707 } }
I20260806 16:57:03.232172 9001 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:03.233389 9007 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1f82afc59aa41268350df1c37749400" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f82afc59aa41268350df1c37749400" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42707 } } }
I20260806 16:57:03.233525 9007 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:03.234047 9008 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1f82afc59aa41268350df1c37749400. Latest consensus state: current_term: 1 leader_uuid: "f1f82afc59aa41268350df1c37749400" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f82afc59aa41268350df1c37749400" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42707 } } }
I20260806 16:57:03.234213 9008 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400 [sys.catalog]: This master's current role is: LEADER
W20260806 16:57:03.237596 9021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:03.237679 9021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:03.237772 9015 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:03.238682 9015 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:03.245318 9015 catalog_manager.cc:1347] Generated new cluster ID: bd71565213294f3aa94430f728a7540f
I20260806 16:57:03.245425 9015 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:03.290669 9015 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:03.292285 9015 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:03.303447 9015 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: Generated new TSK 0
I20260806 16:57:03.304344 9015 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:03.351377 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42707
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:03.478277 9027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:03.478628 9027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:03.478681 9027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:03.483654 9027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:03.483748 9027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:03.483796 9027 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:03.483834 9027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:03.490111 9027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:42707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:03.491397 9027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:03.492420 9027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:03.503278 9032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:03.503326 9027 server_base.cc:1034] running on GCE node
W20260806 16:57:03.503280 9035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:03.503280 9033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:03.504220 9027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:03.505097 9027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:03.506316 9027 hybrid_clock.cc:648] HybridClock initialized: now 1786035423506297 us; error 34 us; skew 500 ppm
Aug 06 16:57:03 dist-test-slave-cbsf krb5kdc[8905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035423, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:03.509640 9027 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:03.510640 9027 webserver.cc:460] Webserver started at http://127.7.153.1:37175/ using document root <none> and password file <none>
I20260806 16:57:03.511233 9027 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:03.511297 9027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:03.511477 9027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:03.513878 9027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "3ba3af81b4f648a6b40662d6ac83d8e1"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "49aa6f4dd42c42c5d47d8824dd5c0a2a"
server_key_iv: "8abab910148d0bce3a7b8ca37e75f22c"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.514554 9027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "3ba3af81b4f648a6b40662d6ac83d8e1"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "49aa6f4dd42c42c5d47d8824dd5c0a2a"
server_key_iv: "8abab910148d0bce3a7b8ca37e75f22c"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.518700 9027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:03.521467 9042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:03.522883 9027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:03.523023 9027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "3ba3af81b4f648a6b40662d6ac83d8e1"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "49aa6f4dd42c42c5d47d8824dd5c0a2a"
server_key_iv: "8abab910148d0bce3a7b8ca37e75f22c"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.523147 9027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:03.555197 9027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:03.558698 9027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:03.558882 9027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:03.560529 9027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:03.560616 9027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:03.560737 9027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:03.560798 9027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 06 16:57:03 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035423, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:03.572291 9027 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:37709
I20260806 16:57:03.572381 9163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:37709 every 8 connection(s)
I20260806 16:57:03.573359 9027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:03.575606 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.561416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:59485 (local address 127.7.153.62:42707)
0806 16:57:03.561601 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:03.561607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:03.563092 (+ 1485us) server_negotiation.cc:407] Connection header received
0806 16:57:03.564640 (+ 1548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:03.564645 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:03.564742 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:03.564839 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:03.566183 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.566753 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.568058 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.568317 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.568439 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.571670 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:03.571673 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:03.571676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:03.571704 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:03.573396 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.574067 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.574070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.574072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.574187 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.574564 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.574566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.574568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.574777 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:03.574860 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:03.575352 (+ 492us) server_negotiation.cc:299] Negotiation successful
0806 16:57:03.575477 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 16:57:03.576470 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.562324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.7.153.1:59485)
0806 16:57:03.562903 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:03.562964 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:03.564325 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:03.565051 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:03.565059 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:03.565493 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:03.566011 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.566025 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.566895 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.566900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.567919 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.567930 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.568488 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.568492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.568680 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.569387 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:03.569405 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:03.571418 (+ 2013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:03.573541 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.573547 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.573564 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.573889 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.574311 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.574314 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.574315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.574453 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.574879 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:03.574884 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:03.575134 (+ 250us) client_negotiation.cc:769] Sending connection context
0806 16:57:03.575297 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 16:57:03.575572 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":162,"threads_started":1}
I20260806 16:57:03.578001 9164 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42707
I20260806 16:57:03.578181 9164 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:03.578723 9164 heartbeater.cc:511] Master 127.7.153.62:42707 requested a full tablet report, sending...
I20260806 16:57:03.580333 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9027
I20260806 16:57:03.580444 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:03.580530 8951 ts_manager.cc:194] Registered new tserver with Master: 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709)
I20260806 16:57:03.580781 7780 external_mini_cluster.cc:1428] Setting key 63804567fe0668effe57a20ef7762000
I20260806 16:57:03.581982 8951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:59485
I20260806 16:57:03.590291 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.580520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:50701 (local address 127.7.153.62:42707)
0806 16:57:03.580646 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:03.580651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:03.580914 (+ 263us) server_negotiation.cc:407] Connection header received
0806 16:57:03.581063 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:03.581067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:03.581123 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:03.581200 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:03.582665 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.583363 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.584729 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.585120 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.585247 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.586447 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:03.586453 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:03.586459 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:03.586493 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:03.588314 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.588938 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.588941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.588942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.589037 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.589406 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.589409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.589410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.589603 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:03.589682 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:03.590042 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 16:57:03.590154 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1333,"server-negotiator.queue_time_us":53}
I20260806 16:57:03.590416 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.580452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.7.153.1:50701)
0806 16:57:03.580835 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:03.580851 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:03.580957 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:03.581337 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:03.581339 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:03.581586 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:03.581723 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.581731 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.583506 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.583512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.584552 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.584568 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.585249 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.585251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.585325 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.585928 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:03.585942 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:03.586293 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:03.588457 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.588461 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.588464 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.588809 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.589176 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.589182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.589186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.589300 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.589708 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:03.589713 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:03.589849 (+ 136us) client_negotiation.cc:769] Sending connection context
0806 16:57:03.589986 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 16:57:03.590175 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:03.612370 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42707
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:03.739552 9173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:03.739912 9173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:03.740008 9173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:03.744336 9173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:03.744462 9173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:03.744542 9173 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:03.744630 9173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:03.750523 9173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:42707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:03.751804 9173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:03.753094 9173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:03.764487 9179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:03.764458 9178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:03.764667 9173 server_base.cc:1034] running on GCE node
W20260806 16:57:03.764557 9181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:03.765342 9173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:03.766135 9173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:03.767357 9173 hybrid_clock.cc:648] HybridClock initialized: now 1786035423767329 us; error 46 us; skew 500 ppm
Aug 06 16:57:03 dist-test-slave-cbsf krb5kdc[8905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035423, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:03.770669 9173 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:03.771821 9173 webserver.cc:460] Webserver started at http://127.7.153.2:38215/ using document root <none> and password file <none>
I20260806 16:57:03.772500 9173 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:03.772606 9173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:03.772962 9173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:03.775346 9173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "fdc24582d8954ad6a0fc7306d2aa9161"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "d0aaafa62f4cc21e9648d41d83f5d8a5"
server_key_iv: "e01efe5c40b65db4323f8c521a20b5f8"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.776021 9173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "fdc24582d8954ad6a0fc7306d2aa9161"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "d0aaafa62f4cc21e9648d41d83f5d8a5"
server_key_iv: "e01efe5c40b65db4323f8c521a20b5f8"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.780854 9173 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 16:57:03.783875 9188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:03.785393 9173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:03.785559 9173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "fdc24582d8954ad6a0fc7306d2aa9161"
format_stamp: "Formatted at 2026-08-06 16:57:03 on dist-test-slave-cbsf"
server_key: "d0aaafa62f4cc21e9648d41d83f5d8a5"
server_key_iv: "e01efe5c40b65db4323f8c521a20b5f8"
server_key_version: "encryptionkey@0"
I20260806 16:57:03.785698 9173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:03.796029 9173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:03.800200 9173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:03.800469 9173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:03.802551 9173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:03.802635 9173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:03.802708 9173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:03.802753 9173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:03 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035423, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:03.814635 9173 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:43345
I20260806 16:57:03.815089 9309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:43345 every 8 connection(s)
I20260806 16:57:03.815788 9173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:03.818255 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.803483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:44683 (local address 127.7.153.62:42707)
0806 16:57:03.803676 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:03.803682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:03.804656 (+ 974us) server_negotiation.cc:407] Connection header received
0806 16:57:03.805926 (+ 1270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:03.805929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:03.805995 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:03.806127 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:03.807404 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.808324 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.810543 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.810853 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.811032 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.814064 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:03.814070 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:03.814078 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:03.814109 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:03.815808 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.816450 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.816454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.816456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.816565 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.817014 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.817016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.817018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.817279 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:03.817369 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:03.817977 (+ 608us) server_negotiation.cc:299] Negotiation successful
0806 16:57:03.818115 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 16:57:03.819089 9197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.803970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.7.153.2:44683)
0806 16:57:03.804465 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:03.804518 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:03.805672 (+ 1154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:03.806307 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:03.806317 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:03.806718 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:03.807235 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.807249 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.808547 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.808554 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.810338 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.810358 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.811150 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.811157 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.811353 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.812054 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:03.812073 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:03.813834 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:03.815956 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.815963 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.815980 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.816308 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.816679 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.816682 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.816684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.816885 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.817394 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:03.817400 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:03.817681 (+ 281us) client_negotiation.cc:769] Sending connection context
0806 16:57:03.817849 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 16:57:03.818160 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":148,"threads_started":1}
I20260806 16:57:03.820752 9310 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42707
I20260806 16:57:03.820951 9310 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:03.821372 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9173
I20260806 16:57:03.821488 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:03.821604 9310 heartbeater.cc:511] Master 127.7.153.62:42707 requested a full tablet report, sending...
I20260806 16:57:03.821846 7780 external_mini_cluster.cc:1428] Setting key fa80858c0566e834bc62fe37a9dff28f
I20260806 16:57:03.822907 8951 ts_manager.cc:194] Registered new tserver with Master: fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345)
I20260806 16:57:03.823706 8951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:44683
I20260806 16:57:03.831876 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.823451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:48087 (local address 127.7.153.62:42707)
0806 16:57:03.823585 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:03.823592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:03.823910 (+ 318us) server_negotiation.cc:407] Connection header received
0806 16:57:03.824074 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:03.824077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:03.824126 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:03.824219 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:03.824983 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.825812 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.826672 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.826986 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.827101 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.828381 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:03.828384 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:03.828387 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:03.828414 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:03.830026 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.830494 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.830498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.830500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.830594 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:03.830904 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:03.830907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:03.830909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:03.831174 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:03.831288 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:03.831571 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 16:57:03.831705 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 16:57:03.831892 9316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:03.823482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.7.153.2:48087)
0806 16:57:03.823830 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:03.823846 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:03.823954 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:03.824237 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:03.824240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:03.824671 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:03.824838 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.824848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.825966 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.825975 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.826534 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:03.826543 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:03.827118 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:03.827122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:03.827224 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:03.827796 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:03.827808 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:03.828234 (+ 426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:03.830159 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.830163 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.830165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.830387 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.830701 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:03.830705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:03.830706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:03.830802 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:03.831288 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:03.831291 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:03.831399 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 16:57:03.831510 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 16:57:03.831691 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":27,"thread_start_us":131,"threads_started":1}
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:03.853325 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42707
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:03.983273 9319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:03.983636 9319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:03.983690 9319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:03.988152 9319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:03.988255 9319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:03.988300 9319 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:03.988336 9319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:03.994728 9319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:42707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:03.996867 9319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:03.998206 9319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:04.009464 9325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:04.009464 9327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:04.009464 9324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:04.009871 9319 server_base.cc:1034] running on GCE node
I20260806 16:57:04.010408 9319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:04.011270 9319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:04.012485 9319 hybrid_clock.cc:648] HybridClock initialized: now 1786035424012462 us; error 40 us; skew 500 ppm
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[8905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035424, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:04.016242 9319 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:04.017385 9319 webserver.cc:460] Webserver started at http://127.7.153.3:40849/ using document root <none> and password file <none>
I20260806 16:57:04.018019 9319 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:04.018095 9319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:04.018285 9319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:04.020859 9319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "470e7bda0bce4e71a2f8bf3380274e88"
format_stamp: "Formatted at 2026-08-06 16:57:04 on dist-test-slave-cbsf"
server_key: "b3aa7548aefe42d42e9ff87c4024e7e1"
server_key_iv: "675a84aa436b7fc1f5c353907131df8e"
server_key_version: "encryptionkey@0"
I20260806 16:57:04.021548 9319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "470e7bda0bce4e71a2f8bf3380274e88"
format_stamp: "Formatted at 2026-08-06 16:57:04 on dist-test-slave-cbsf"
server_key: "b3aa7548aefe42d42e9ff87c4024e7e1"
server_key_iv: "675a84aa436b7fc1f5c353907131df8e"
server_key_version: "encryptionkey@0"
I20260806 16:57:04.026068 9319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260806 16:57:04.029152 9334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:04.030673 9319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 16:57:04.030839 9319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "470e7bda0bce4e71a2f8bf3380274e88"
format_stamp: "Formatted at 2026-08-06 16:57:04 on dist-test-slave-cbsf"
server_key: "b3aa7548aefe42d42e9ff87c4024e7e1"
server_key_iv: "675a84aa436b7fc1f5c353907131df8e"
server_key_version: "encryptionkey@0"
I20260806 16:57:04.030975 9319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:04.052136 9319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:04.055953 9319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:04.056219 9319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:04.058161 9319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:04.058255 9319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:04.058331 9319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:04.058375 9319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:04.071619 9319 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:36959
I20260806 16:57:04.071678 9458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:36959 every 8 connection(s)
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035424, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:04.073068 9319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:04.078454 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.059767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:42505 (local address 127.7.153.62:42707)
0806 16:57:04.060036 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.060050 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.061324 (+ 1274us) server_negotiation.cc:407] Connection header received
0806 16:57:04.062783 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.062788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.062877 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.063002 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:04.065035 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.065949 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.068047 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.068482 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.068650 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.072993 (+ 4343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:04.072999 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:04.073002 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:04.073050 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:04.075660 (+ 2610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.076490 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.076495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.076497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.076648 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.077127 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.077130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.077132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.077376 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:04.077502 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.078092 (+ 590us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.078267 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260806 16:57:04.079448 9343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.060417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.7.153.3:42505)
0806 16:57:04.061113 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.061172 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.062455 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.063221 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.063229 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.063801 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:04.064769 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.064800 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.066183 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.066186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.067870 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.067883 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.068774 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.068780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.069035 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.069926 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:04.069952 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:04.072538 (+ 2586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:04.075872 (+ 3334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:04.075879 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:04.075901 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:04.076361 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:04.076822 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:04.076825 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:04.076827 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:04.077003 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:04.077497 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:04.077505 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:04.077815 (+ 310us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.078030 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.078500 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":226,"threads_started":1}
I20260806 16:57:04.081256 9459 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42707
I20260806 16:57:04.081488 9459 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:04.082226 9459 heartbeater.cc:511] Master 127.7.153.62:42707 requested a full tablet report, sending...
I20260806 16:57:04.082405 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9319
I20260806 16:57:04.082537 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:04.082876 7780 external_mini_cluster.cc:1428] Setting key 99805f6284d468fe04b5d2566a0ecdcb
I20260806 16:57:04.083586 8951 ts_manager.cc:194] Registered new tserver with Master: 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959)
I20260806 16:57:04.084218 8951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:42505
I20260806 16:57:04.085170 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:57:04.094831 9465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.085084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.7.153.3:42457)
0806 16:57:04.086632 (+ 1548us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.086646 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.086799 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.087066 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.087068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.087314 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:04.087424 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.087430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.088221 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.088225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.088894 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.088904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.089385 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.089388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.089486 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.090191 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:04.090204 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:04.090581 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:04.092801 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:04.092805 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:04.092807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:04.093045 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:04.093451 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:04.093453 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:04.093455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:04.093557 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:04.094187 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:04.094190 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:04.094311 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.094434 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.094644 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1467,"thread_start_us":119,"threads_started":1}
I20260806 16:57:04.094892 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.084852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:42457 (local address 127.7.153.62:42707)
0806 16:57:04.084984 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.084990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.086754 (+ 1764us) server_negotiation.cc:407] Connection header received
0806 16:57:04.086895 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.086898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.086953 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.087044 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:04.087553 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.088089 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.089026 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.089260 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.089378 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.090779 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:04.090785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:04.090788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:04.090816 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:04.092627 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.093166 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.093169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.093171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.093306 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.093664 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.093670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.093672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.093992 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:04.094113 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.094524 (+ 411us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.094690 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[8905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035424, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035424, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:04.117811 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.107503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54004 (local address 127.7.153.62:42707)
0806 16:57:04.107714 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.107717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.107736 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:04.107789 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.107791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.107833 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.107914 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:04.108820 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.109380 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.110346 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.110599 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.110692 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.114333 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:04.114337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:04.114339 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:04.114373 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:04.115871 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.116411 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.116414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.116416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.116509 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.116890 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.116893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.116894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.117109 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:04.117234 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.117472 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.117602 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 16:57:04.121366 8952 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:04.124913 8952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:04.142262 9476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.135464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:43345 (local address 127.0.0.1:56928)
0806 16:57:04.137308 (+ 1844us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.137320 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.137431 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.137832 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.137835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.137852 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.137975 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.137982 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.139397 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.139399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.140383 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.140394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.141592 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.141595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.141729 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.141775 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.141905 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.142076 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1788,"mutex_wait_us":58,"thread_start_us":89,"threads_started":1}
I20260806 16:57:04.142477 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.135156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:36959 (local address 127.0.0.1:40912)
0806 16:57:04.136148 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.136161 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.136255 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.137090 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.137093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.137117 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.137336 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.137344 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.138881 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.138884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.140715 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.140728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.142024 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.142028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.142131 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.142157 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.142231 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.142320 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":929,"mutex_wait_us":399,"spinlock_wait_cycles":4224,"thread_start_us":110,"threads_started":1}
I20260806 16:57:04.142807 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.135162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.7.153.1:37709)
0806 16:57:04.136501 (+ 1339us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.136509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.136533 (+ 24us) server_negotiation.cc:407] Connection header received
0806 16:57:04.136615 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.136621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.136869 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.137035 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.137486 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.138744 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.140879 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.141456 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.141591 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.141754 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.142109 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.142215 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1243,"thread_start_us":102,"threads_started":1}
I20260806 16:57:04.143026 9481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.135805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.7.153.3:36959)
0806 16:57:04.136651 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.136662 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.136680 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:57:04.136801 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.136805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.136962 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.137095 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.137487 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.138733 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.140867 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.141685 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.141805 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.141952 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.142779 (+ 827us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.142876 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":121,"threads_started":1}
I20260806 16:57:04.143220 9479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.134992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37709 (local address 127.0.0.1:52890)
0806 16:57:04.135999 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.136082 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.136219 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.137028 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.137033 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.137080 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.137336 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.137344 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.138881 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.138884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.140726 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.140732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.141819 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.141822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.141919 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.141937 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.141997 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.143047 (+ 1050us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"mutex_wait_us":1169,"spinlock_wait_cycles":896,"thread_start_us":103,"threads_started":1}
I20260806 16:57:04.143234 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.135757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56928 (local address 127.7.153.2:43345)
0806 16:57:04.136457 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.136469 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.137425 (+ 956us) server_negotiation.cc:407] Connection header received
0806 16:57:04.137555 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.137559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.137692 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.137853 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.138106 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.138990 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.140517 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.141434 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.141559 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.141756 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.141961 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.142846 (+ 885us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":117,"threads_started":1}
I20260806 16:57:04.146421 9242 tablet_service.cc:1467] Processing CreateTablet for tablet e229006c5ac64283a40eea659627ccf8 (DEFAULT_TABLE table=test-table [id=91bee8f179f847209ce2a6020a328658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:04.146418 9096 tablet_service.cc:1467] Processing CreateTablet for tablet e229006c5ac64283a40eea659627ccf8 (DEFAULT_TABLE table=test-table [id=91bee8f179f847209ce2a6020a328658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:04.148027 9242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e229006c5ac64283a40eea659627ccf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.148027 9096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e229006c5ac64283a40eea659627ccf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.150678 9388 tablet_service.cc:1467] Processing CreateTablet for tablet e229006c5ac64283a40eea659627ccf8 (DEFAULT_TABLE table=test-table [id=91bee8f179f847209ce2a6020a328658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:04.151894 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e229006c5ac64283a40eea659627ccf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.159159 9482 tablet_bootstrap.cc:492] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Bootstrap starting.
I20260806 16:57:04.159997 9484 tablet_bootstrap.cc:492] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Bootstrap starting.
I20260806 16:57:04.161166 9483 tablet_bootstrap.cc:492] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Bootstrap starting.
I20260806 16:57:04.161761 9482 tablet_bootstrap.cc:654] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.162482 9484 tablet_bootstrap.cc:654] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.162581 9482 log.cc:824] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:04.163321 9484 log.cc:824] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:04.163533 9483 tablet_bootstrap.cc:654] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.164324 9483 log.cc:824] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:04.164886 9482 tablet_bootstrap.cc:492] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: No bootstrap required, opened a new log
I20260806 16:57:04.165411 9482 ts_tablet_manager.cc:1397] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 16:57:04.165594 9484 tablet_bootstrap.cc:492] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: No bootstrap required, opened a new log
I20260806 16:57:04.165798 9484 ts_tablet_manager.cc:1397] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 16:57:04.166730 9483 tablet_bootstrap.cc:492] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: No bootstrap required, opened a new log
I20260806 16:57:04.166939 9483 ts_tablet_manager.cc:1397] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 16:57:04.169416 9482 raft_consensus.cc:348] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.169703 9482 raft_consensus.cc:374] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.169768 9482 raft_consensus.cc:729] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba3af81b4f648a6b40662d6ac83d8e1, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.170063 9484 raft_consensus.cc:348] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.170254 9482 consensus_queue.cc:260] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.170356 9484 raft_consensus.cc:374] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.170429 9484 raft_consensus.cc:729] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470e7bda0bce4e71a2f8bf3380274e88, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.170900 9484 consensus_queue.cc:260] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.171012 9164 heartbeater.cc:503] Master 127.7.153.62:42707 was elected leader, sending a full tablet report...
I20260806 16:57:04.171146 9483 raft_consensus.cc:348] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.171444 9483 raft_consensus.cc:374] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.171515 9483 raft_consensus.cc:729] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc24582d8954ad6a0fc7306d2aa9161, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.171921 9483 consensus_queue.cc:260] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.172073 9484 ts_tablet_manager.cc:1428] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 16:57:04.172199 9459 heartbeater.cc:503] Master 127.7.153.62:42707 was elected leader, sending a full tablet report...
I20260806 16:57:04.172665 9310 heartbeater.cc:503] Master 127.7.153.62:42707 was elected leader, sending a full tablet report...
I20260806 16:57:04.172986 9483 ts_tablet_manager.cc:1428] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260806 16:57:04.174043 9482 ts_tablet_manager.cc:1428] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260806 16:57:04.304805 9489 raft_consensus.cc:482] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:04.305076 9489 raft_consensus.cc:504] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.306803 9489 leader_election.cc:288] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709), fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345)
I20260806 16:57:04.310823 9343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.307087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:43345 (local address 127.7.153.3:60427)
0806 16:57:04.307220 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.307237 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.307346 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.307749 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.307755 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.307774 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.307895 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.307900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.308682 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.308712 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.309754 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.309768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.310444 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.310457 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.310566 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.310587 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.310645 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.310705 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":22}
I20260806 16:57:04.310912 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.307266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:60427 (local address 127.7.153.2:43345)
0806 16:57:04.307421 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.307428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.307447 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:04.307509 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.307512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.307591 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.307717 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.308043 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.308565 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.309899 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.310314 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.310399 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.310493 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.310690 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.310785 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 16:57:04.311770 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.307220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:34527 (local address 127.7.153.1:37709)
0806 16:57:04.307343 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.307348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.307694 (+ 346us) server_negotiation.cc:407] Connection header received
0806 16:57:04.307810 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.307814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.307867 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.307927 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.308812 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.309287 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.310517 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.311173 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.311279 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.311340 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.311560 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.311639 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 16:57:04.311775 9491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.307090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37709 (local address 127.7.153.3:34527)
0806 16:57:04.307596 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.307608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.307720 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.307971 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.307976 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.307997 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.308636 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.308649 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.309407 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.309410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.310353 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.310387 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.311306 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.311310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.311420 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.311438 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.311529 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.311597 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"mutex_wait_us":180,"thread_start_us":162,"threads_started":1}
I20260806 16:57:04.311722 9262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e229006c5ac64283a40eea659627ccf8" candidate_uuid: "470e7bda0bce4e71a2f8bf3380274e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" is_pre_election: true
I20260806 16:57:04.312103 9262 raft_consensus.cc:2454] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470e7bda0bce4e71a2f8bf3380274e88 in term 0.
I20260806 16:57:04.312441 9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e229006c5ac64283a40eea659627ccf8" candidate_uuid: "470e7bda0bce4e71a2f8bf3380274e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" is_pre_election: true
I20260806 16:57:04.312873 9338 leader_election.cc:302] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470e7bda0bce4e71a2f8bf3380274e88, fdc24582d8954ad6a0fc7306d2aa9161; no voters:
I20260806 16:57:04.313035 9116 raft_consensus.cc:2454] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470e7bda0bce4e71a2f8bf3380274e88 in term 0.
I20260806 16:57:04.313498 9489 raft_consensus.cc:2781] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:04.313623 9489 raft_consensus.cc:482] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:04.313707 9489 raft_consensus.cc:3037] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.314841 9489 raft_consensus.cc:504] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.315685 9489 leader_election.cc:288] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [CANDIDATE]: Term 1 election: Requested vote from peers 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709), fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345)
I20260806 16:57:04.316155 9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e229006c5ac64283a40eea659627ccf8" candidate_uuid: "470e7bda0bce4e71a2f8bf3380274e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1"
I20260806 16:57:04.316172 9262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e229006c5ac64283a40eea659627ccf8" candidate_uuid: "470e7bda0bce4e71a2f8bf3380274e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc24582d8954ad6a0fc7306d2aa9161"
I20260806 16:57:04.316329 9262 raft_consensus.cc:3037] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.316298 9116 raft_consensus.cc:3037] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Advancing to term 1
W20260806 16:57:04.317310 9311 tablet.cc:2369] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:04.317828 9116 raft_consensus.cc:2454] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470e7bda0bce4e71a2f8bf3380274e88 in term 1.
I20260806 16:57:04.317838 9262 raft_consensus.cc:2454] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470e7bda0bce4e71a2f8bf3380274e88 in term 1.
I20260806 16:57:04.318223 9338 leader_election.cc:302] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470e7bda0bce4e71a2f8bf3380274e88, fdc24582d8954ad6a0fc7306d2aa9161; no voters:
I20260806 16:57:04.318430 9489 raft_consensus.cc:2781] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:04.318668 9489 raft_consensus.cc:686] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 LEADER]: Becoming Leader. State: Replica: 470e7bda0bce4e71a2f8bf3380274e88, State: Running, Role: LEADER
I20260806 16:57:04.319057 9489 consensus_queue.cc:237] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } }
I20260806 16:57:04.322886 8950 catalog_manager.cc:5495] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "470e7bda0bce4e71a2f8bf3380274e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } health_report { overall_health: UNKNOWN } } }
W20260806 16:57:04.324494 9460 tablet.cc:2369] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:57:04.324879 9165 tablet.cc:2369] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:04.341144 9481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.337012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.7.153.3:36959)
0806 16:57:04.337177 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.337184 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.337204 (+ 20us) server_negotiation.cc:407] Connection header received
0806 16:57:04.337476 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.337478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.337540 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.337644 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:04.337960 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.338492 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.339469 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.339695 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.339805 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.340191 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.340654 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.340806 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.340885 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.340953 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 16:57:04.347729 9116 raft_consensus.cc:1261] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Refusing update from remote peer 470e7bda0bce4e71a2f8bf3380274e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:04.347729 9262 raft_consensus.cc:1261] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Refusing update from remote peer 470e7bda0bce4e71a2f8bf3380274e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:04.348650 9492 consensus_queue.cc:1035] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:04.348915 9489 consensus_queue.cc:1035] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:04.370864 8949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:04.371181 8949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:04.374436 8949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: Sending DeleteTablet for 3 replicas of tablet e229006c5ac64283a40eea659627ccf8
I20260806 16:57:04.375590 9242 tablet_service.cc:1514] Processing DeleteTablet for tablet e229006c5ac64283a40eea659627ccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:04 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:56928
I20260806 16:57:04.375558 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet e229006c5ac64283a40eea659627ccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:04 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40912
I20260806 16:57:04.375602 9096 tablet_service.cc:1514] Processing DeleteTablet for tablet e229006c5ac64283a40eea659627ccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:04 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:52890
I20260806 16:57:04.376245 9508 tablet_replica.cc:330] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: stopping tablet replica
I20260806 16:57:04.376665 9508 raft_consensus.cc:2229] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:04.376995 9506 tablet_replica.cc:330] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: stopping tablet replica
I20260806 16:57:04.377111 9508 raft_consensus.cc:2258] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:04.377485 9506 raft_consensus.cc:2229] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:04.377545 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 16:57:04.378028 9506 raft_consensus.cc:2258] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 16:57:04.378166 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:04.378592 9507 tablet_replica.cc:330] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: stopping tablet replica
I20260806 16:57:04.379266 9508 ts_tablet_manager.cc:1905] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:04.380036 9506 ts_tablet_manager.cc:1905] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:04.382059 9507 raft_consensus.cc:2229] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:04.382848 9508 ts_tablet_manager.cc:1918] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:04.382983 9508 log.cc:1196] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/e229006c5ac64283a40eea659627ccf8
I20260806 16:57:04.383461 9508 ts_tablet_manager.cc:1939] T e229006c5ac64283a40eea659627ccf8 P 3ba3af81b4f648a6b40662d6ac83d8e1: Deleting consensus metadata
I20260806 16:57:04.383601 9507 raft_consensus.cc:2258] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:04.384631 9506 ts_tablet_manager.cc:1918] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:04.384904 9506 log.cc:1196] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/e229006c5ac64283a40eea659627ccf8
I20260806 16:57:04.385299 9506 ts_tablet_manager.cc:1939] T e229006c5ac64283a40eea659627ccf8 P fdc24582d8954ad6a0fc7306d2aa9161: Deleting consensus metadata
I20260806 16:57:04.385278 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 9487f5a3c1454fd4a28936fd4c81f325 (DEFAULT_TABLE table=test-table [id=31baa2fc17ad4c2f81dde1fb624f2e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:04.385278 9096 tablet_service.cc:1467] Processing CreateTablet for tablet 9487f5a3c1454fd4a28936fd4c81f325 (DEFAULT_TABLE table=test-table [id=31baa2fc17ad4c2f81dde1fb624f2e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:04.385591 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9487f5a3c1454fd4a28936fd4c81f325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.385591 9096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9487f5a3c1454fd4a28936fd4c81f325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.388324 9482 tablet_bootstrap.cc:492] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Bootstrap starting.
I20260806 16:57:04.388482 9484 tablet_bootstrap.cc:492] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Bootstrap starting.
I20260806 16:57:04.389020 8938 catalog_manager.cc:4841] TS fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345): tablet e229006c5ac64283a40eea659627ccf8 (table test-table [id=91bee8f179f847209ce2a6020a328658]) successfully deleted
I20260806 16:57:04.389364 8937 catalog_manager.cc:4841] TS 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709): tablet e229006c5ac64283a40eea659627ccf8 (table test-table [id=91bee8f179f847209ce2a6020a328658]) successfully deleted
I20260806 16:57:04.389639 9484 tablet_bootstrap.cc:654] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.389660 9482 tablet_bootstrap.cc:654] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.390973 9242 tablet_service.cc:1467] Processing CreateTablet for tablet 9487f5a3c1454fd4a28936fd4c81f325 (DEFAULT_TABLE table=test-table [id=31baa2fc17ad4c2f81dde1fb624f2e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:04.391284 9242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9487f5a3c1454fd4a28936fd4c81f325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.391284 9484 tablet_bootstrap.cc:492] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: No bootstrap required, opened a new log
I20260806 16:57:04.391381 9484 ts_tablet_manager.cc:1397] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:04.391973 9484 raft_consensus.cc:348] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.392099 9484 raft_consensus.cc:374] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.392129 9484 raft_consensus.cc:729] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470e7bda0bce4e71a2f8bf3380274e88, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.392257 9484 consensus_queue.cc:260] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.392526 9484 ts_tablet_manager.cc:1428] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 16:57:04.393968 9483 tablet_bootstrap.cc:492] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Bootstrap starting.
I20260806 16:57:04.394791 9507 ts_tablet_manager.cc:1905] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:04.394969 9483 tablet_bootstrap.cc:654] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.397404 9482 tablet_bootstrap.cc:492] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: No bootstrap required, opened a new log
I20260806 16:57:04.397403 9483 tablet_bootstrap.cc:492] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: No bootstrap required, opened a new log
I20260806 16:57:04.397516 9482 ts_tablet_manager.cc:1397] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260806 16:57:04.397516 9483 ts_tablet_manager.cc:1397] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 16:57:04.398056 9483 raft_consensus.cc:348] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.398191 9483 raft_consensus.cc:374] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.398238 9483 raft_consensus.cc:729] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc24582d8954ad6a0fc7306d2aa9161, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.398244 9482 raft_consensus.cc:348] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.398363 9482 raft_consensus.cc:374] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.398393 9482 raft_consensus.cc:729] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba3af81b4f648a6b40662d6ac83d8e1, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.398391 9483 consensus_queue.cc:260] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.398520 9482 consensus_queue.cc:260] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.398696 9483 ts_tablet_manager.cc:1428] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:04.399466 9482 ts_tablet_manager.cc:1428] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 16:57:04.400283 9507 ts_tablet_manager.cc:1918] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:04.400424 9507 log.cc:1196] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/e229006c5ac64283a40eea659627ccf8
I20260806 16:57:04.400910 9507 ts_tablet_manager.cc:1939] T e229006c5ac64283a40eea659627ccf8 P 470e7bda0bce4e71a2f8bf3380274e88: Deleting consensus metadata
I20260806 16:57:04.402328 8936 catalog_manager.cc:4841] TS 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959): tablet e229006c5ac64283a40eea659627ccf8 (table test-table [id=91bee8f179f847209ce2a6020a328658]) successfully deleted
I20260806 16:57:04.497287 9490 raft_consensus.cc:482] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:04.497486 9490 raft_consensus.cc:504] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.498842 9490 leader_election.cc:288] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709), 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959)
I20260806 16:57:04.504189 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.499321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:32823 (local address 127.7.153.1:37709)
0806 16:57:04.499490 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.499495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.499896 (+ 401us) server_negotiation.cc:407] Connection header received
0806 16:57:04.500027 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.500031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.500123 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.500376 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.500839 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.501654 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.502808 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.503465 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.503611 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.503696 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.503945 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.504054 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 16:57:04.504195 9512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.499074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37709 (local address 127.7.153.2:32823)
0806 16:57:04.499559 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.499574 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.499727 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.500500 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.500503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.500522 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.500634 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.500641 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.501801 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.501807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.502667 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.502677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.503659 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.503664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.503781 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.503811 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.503908 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.503992 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":127,"threads_started":1}
I20260806 16:57:04.504280 9481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.499239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:45903 (local address 127.7.153.3:36959)
0806 16:57:04.499402 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.499407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.499814 (+ 407us) server_negotiation.cc:407] Connection header received
0806 16:57:04.500014 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.500017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.500072 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.500156 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.500463 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.501321 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.502953 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.503555 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.503648 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.503703 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.504068 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.504148 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:04.505146 9514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.499082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:36959 (local address 127.7.153.2:45903)
0806 16:57:04.499730 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.499742 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.499879 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.500180 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.500183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.500202 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.500337 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.500344 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.501469 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.501474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.502805 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.502818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.503766 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.503770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.503908 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.503933 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.504659 (+ 726us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.504931 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":282,"thread_start_us":128,"threads_started":1}
I20260806 16:57:04.505169 9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9487f5a3c1454fd4a28936fd4c81f325" candidate_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" is_pre_election: true
I20260806 16:57:04.505365 9116 raft_consensus.cc:2454] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc24582d8954ad6a0fc7306d2aa9161 in term 0.
I20260806 16:57:04.505960 9408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9487f5a3c1454fd4a28936fd4c81f325" candidate_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470e7bda0bce4e71a2f8bf3380274e88" is_pre_election: true
I20260806 16:57:04.505987 9191 leader_election.cc:302] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba3af81b4f648a6b40662d6ac83d8e1, fdc24582d8954ad6a0fc7306d2aa9161; no voters:
I20260806 16:57:04.506242 9408 raft_consensus.cc:2454] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc24582d8954ad6a0fc7306d2aa9161 in term 0.
I20260806 16:57:04.506304 9490 raft_consensus.cc:2781] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:04.506352 9490 raft_consensus.cc:482] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:04.506397 9490 raft_consensus.cc:3037] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.507709 9490 raft_consensus.cc:504] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.508152 9490 leader_election.cc:288] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [CANDIDATE]: Term 1 election: Requested vote from peers 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709), 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959)
I20260806 16:57:04.508554 9408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9487f5a3c1454fd4a28936fd4c81f325" candidate_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470e7bda0bce4e71a2f8bf3380274e88"
I20260806 16:57:04.508625 9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9487f5a3c1454fd4a28936fd4c81f325" candidate_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1"
I20260806 16:57:04.508734 9408 raft_consensus.cc:3037] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.508816 9116 raft_consensus.cc:3037] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.510005 9408 raft_consensus.cc:2454] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc24582d8954ad6a0fc7306d2aa9161 in term 1.
I20260806 16:57:04.510159 9116 raft_consensus.cc:2454] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc24582d8954ad6a0fc7306d2aa9161 in term 1.
I20260806 16:57:04.510408 9190 leader_election.cc:302] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470e7bda0bce4e71a2f8bf3380274e88, fdc24582d8954ad6a0fc7306d2aa9161; no voters:
I20260806 16:57:04.510589 9490 raft_consensus.cc:2781] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:04.510872 9490 raft_consensus.cc:686] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 LEADER]: Becoming Leader. State: Replica: fdc24582d8954ad6a0fc7306d2aa9161, State: Running, Role: LEADER
I20260806 16:57:04.511168 9490 consensus_queue.cc:237] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.514330 8949 catalog_manager.cc:5495] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } health_report { overall_health: UNKNOWN } } }
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035423, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:04.557747 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.547160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.7.153.62:42707)
0806 16:57:04.547339 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.547344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.547524 (+ 180us) server_negotiation.cc:407] Connection header received
0806 16:57:04.547653 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.547657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.547711 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.547819 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:04.548564 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.549440 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.550307 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.550606 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.550729 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.554179 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:04.554184 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:04.554187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:04.554221 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:04.555741 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.556317 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.556320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.556321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.556401 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.556785 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.556788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.556789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.557003 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:04.557101 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.557454 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.557606 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":58}
I20260806 16:57:04.557750 9522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.547039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42707 (local address 127.0.0.1:54020)
0806 16:57:04.547416 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.547432 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.547557 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.547862 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.547864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.548327 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:04.548432 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.548439 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.549575 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.549578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.550159 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.550167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.550878 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.550883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.551004 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.551927 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:04.551942 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:04.553959 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:04.555897 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:04.555912 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:04.555919 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:04.556213 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:04.556513 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:04.556516 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:04.556517 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:04.556607 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:04.557120 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:04.557127 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:04.557274 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.557381 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.557538 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":150,"threads_started":1}
I20260806 16:57:04.562518 8949 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:54020:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 16:57:04.563295 8949 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:04.568683 9242 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8bcddd31b24ae19c9e0652b8783ecc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e53b760ad6b44909ba27cbabb4a8a4f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:04.568960 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8bcddd31b24ae19c9e0652b8783ecc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e53b760ad6b44909ba27cbabb4a8a4f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:04.569288 9388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8bcddd31b24ae19c9e0652b8783ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.569291 9242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8bcddd31b24ae19c9e0652b8783ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.568657 9096 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8bcddd31b24ae19c9e0652b8783ecc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e53b760ad6b44909ba27cbabb4a8a4f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:04.571373 9096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8bcddd31b24ae19c9e0652b8783ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:04.572400 9484 tablet_bootstrap.cc:492] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: Bootstrap starting.
I20260806 16:57:04.573182 9484 tablet_bootstrap.cc:654] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.574692 9482 tablet_bootstrap.cc:492] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: Bootstrap starting.
I20260806 16:57:04.575139 9483 tablet_bootstrap.cc:492] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: Bootstrap starting.
I20260806 16:57:04.575850 9482 tablet_bootstrap.cc:654] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.576263 9483 tablet_bootstrap.cc:654] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:04.576421 9484 tablet_bootstrap.cc:492] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: No bootstrap required, opened a new log
I20260806 16:57:04.576524 9484 ts_tablet_manager.cc:1397] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 16:57:04.577064 9484 raft_consensus.cc:348] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.577234 9484 raft_consensus.cc:374] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.577276 9484 raft_consensus.cc:729] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470e7bda0bce4e71a2f8bf3380274e88, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.577414 9484 consensus_queue.cc:260] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.577654 9482 tablet_bootstrap.cc:492] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: No bootstrap required, opened a new log
I20260806 16:57:04.577728 9482 ts_tablet_manager.cc:1397] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:04.577715 9484 ts_tablet_manager.cc:1428] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:04.577754 9489 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.577894 9489 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.578161 9482 raft_consensus.cc:348] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.578266 9482 raft_consensus.cc:374] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.578294 9482 raft_consensus.cc:729] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba3af81b4f648a6b40662d6ac83d8e1, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.578409 9482 consensus_queue.cc:260] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.578655 9482 ts_tablet_manager.cc:1428] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:04.578604 9483 tablet_bootstrap.cc:492] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: No bootstrap required, opened a new log
I20260806 16:57:04.578825 9483 ts_tablet_manager.cc:1397] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260806 16:57:04.579077 9488 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.579209 9488 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.579351 9483 raft_consensus.cc:348] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.579476 9483 raft_consensus.cc:374] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:04.579510 9483 raft_consensus.cc:729] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc24582d8954ad6a0fc7306d2aa9161, State: Initialized, Role: FOLLOWER
I20260806 16:57:04.579664 9483 consensus_queue.cc:260] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.579921 9490 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.580067 9490 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.580308 9483 ts_tablet_manager.cc:1428] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 16:57:04.621268 9488 raft_consensus.cc:482] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:04.621450 9488 raft_consensus.cc:504] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.622655 9488 leader_election.cc:288] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345), 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959)
I20260806 16:57:04.628597 9481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.623108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:57687 (local address 127.7.153.3:36959)
0806 16:57:04.623273 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.623279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.623533 (+ 254us) server_negotiation.cc:407] Connection header received
0806 16:57:04.623684 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.623687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.623747 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.623836 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.624323 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.625189 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.627142 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.627820 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.627942 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.628017 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.628357 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.628472 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 16:57:04.628607 9527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.622958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:36959 (local address 127.7.153.1:57687)
0806 16:57:04.623453 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.623467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.623552 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.623862 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.623864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.623907 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.624192 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.624198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.625335 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.625339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.626987 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.626998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.627969 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.627973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.628177 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.628227 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.628320 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.628413 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":404,"spinlock_wait_cycles":41344,"thread_start_us":127,"threads_started":1}
I20260806 16:57:04.628590 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.623167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:60347 (local address 127.7.153.2:43345)
0806 16:57:04.623375 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.623379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.623485 (+ 106us) server_negotiation.cc:407] Connection header received
0806 16:57:04.623691 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.623694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.623743 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.623833 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:04.624323 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.625209 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.627141 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.627831 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.627942 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.628017 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.628374 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.628473 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260806 16:57:04.629137 9526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.622958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:43345 (local address 127.7.153.1:60347)
0806 16:57:04.623381 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.623397 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.623541 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.623862 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.623864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.623908 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:04.624192 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.624198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.625335 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.625339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.626984 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.626998 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.627969 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.627973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.628187 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.628230 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.628889 (+ 659us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.628985 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":272,"spinlock_wait_cycles":8960,"thread_start_us":145,"threads_started":1}
I20260806 16:57:04.629217 9408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8bcddd31b24ae19c9e0652b8783ecc" candidate_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470e7bda0bce4e71a2f8bf3380274e88" is_pre_election: true
I20260806 16:57:04.629390 9408 raft_consensus.cc:2454] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba3af81b4f648a6b40662d6ac83d8e1 in term 0.
I20260806 16:57:04.629938 9262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8bcddd31b24ae19c9e0652b8783ecc" candidate_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" is_pre_election: true
I20260806 16:57:04.630113 9262 raft_consensus.cc:2454] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba3af81b4f648a6b40662d6ac83d8e1 in term 0.
I20260806 16:57:04.630616 9047 leader_election.cc:302] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3ba3af81b4f648a6b40662d6ac83d8e1, 470e7bda0bce4e71a2f8bf3380274e88, fdc24582d8954ad6a0fc7306d2aa9161; no voters:
I20260806 16:57:04.630939 9488 raft_consensus.cc:2781] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:04.630999 9488 raft_consensus.cc:482] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:04.631027 9488 raft_consensus.cc:3037] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.632220 9488 raft_consensus.cc:504] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.632653 9488 leader_election.cc:288] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [CANDIDATE]: Term 1 election: Requested vote from peers fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345), 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959)
I20260806 16:57:04.633122 9262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8bcddd31b24ae19c9e0652b8783ecc" candidate_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc24582d8954ad6a0fc7306d2aa9161"
I20260806 16:57:04.633222 9408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8bcddd31b24ae19c9e0652b8783ecc" candidate_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470e7bda0bce4e71a2f8bf3380274e88"
I20260806 16:57:04.633275 9262 raft_consensus.cc:3037] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.633366 9408 raft_consensus.cc:3037] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:04.634657 9262 raft_consensus.cc:2454] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba3af81b4f648a6b40662d6ac83d8e1 in term 1.
I20260806 16:57:04.634665 9408 raft_consensus.cc:2454] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ba3af81b4f648a6b40662d6ac83d8e1 in term 1.
I20260806 16:57:04.635162 9044 leader_election.cc:302] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ba3af81b4f648a6b40662d6ac83d8e1, 470e7bda0bce4e71a2f8bf3380274e88; no voters:
I20260806 16:57:04.635417 9488 raft_consensus.cc:2781] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:04.635622 9488 raft_consensus.cc:686] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ba3af81b4f648a6b40662d6ac83d8e1, State: Running, Role: LEADER
I20260806 16:57:04.635936 9488 consensus_queue.cc:237] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } }
I20260806 16:57:04.637602 9528 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: TxnStatusTablet state changed. Reason: New leader 3ba3af81b4f648a6b40662d6ac83d8e1. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.637750 9528 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:04.638213 9530 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 16:57:04.638451 9530 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 16:57:04.639005 8950 catalog_manager.cc:5495] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1). New cstate: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:04.654386 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.649485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52894 (local address 127.7.153.1:37709)
0806 16:57:04.649627 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.649631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.649672 (+ 41us) server_negotiation.cc:407] Connection header received
0806 16:57:04.649911 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.649913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.649970 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.650087 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:04.650535 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.651277 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.652605 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.652996 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.653095 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.653475 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.653960 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.654063 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.654203 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.654264 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 16:57:04.654455 9522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.649319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37709 (local address 127.0.0.1:52894)
0806 16:57:04.649601 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.649619 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.649754 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.650126 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.650130 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.650142 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:04.650268 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.650275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.651416 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.651420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.652424 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.652441 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.653126 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.653130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.653221 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.653292 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.654079 (+ 787us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.654098 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.654183 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.654298 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260806 16:57:04.658847 9262 raft_consensus.cc:1261] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Refusing update from remote peer 3ba3af81b4f648a6b40662d6ac83d8e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:04.659121 9408 raft_consensus.cc:1261] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Refusing update from remote peer 3ba3af81b4f648a6b40662d6ac83d8e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:04.659439 9488 consensus_queue.cc:1035] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:04.659638 9528 consensus_queue.cc:1035] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:04.661451 9489 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: TxnStatusTablet state changed. Reason: New leader 3ba3af81b4f648a6b40662d6ac83d8e1. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.661579 9489 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.662410 9490 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: TxnStatusTablet state changed. Reason: New leader 3ba3af81b4f648a6b40662d6ac83d8e1. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.662528 9490 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.663758 9488 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.663897 9488 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:04.663833 9535 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.663981 9535 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 3ba3af81b4f648a6b40662d6ac83d8e1: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:04.664016 9498 mvcc.cc:205] Tried to move back new op lower bound from 7315601099397017600 to 7315601099311726592. Current Snapshot: MvccSnapshot[applied={T|T < 7315601099397017600}]
I20260806 16:57:04.665509 9497 mvcc.cc:205] Tried to move back new op lower bound from 7315601099397017600 to 7315601099311726592. Current Snapshot: MvccSnapshot[applied={T|T < 7315601099397017600}]
I20260806 16:57:04.666445 9489 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.666594 9489 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P 470e7bda0bce4e71a2f8bf3380274e88: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.668293 9496 mvcc.cc:205] Tried to move back new op lower bound from 7315601099397017600 to 7315601099311726592. Current Snapshot: MvccSnapshot[applied={T|T < 7315601099397017600 or (T in {7315601099397017600})}]
I20260806 16:57:04.668931 9490 tablet_replica.cc:439] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 } } peers { permanent_uuid: "fdc24582d8954ad6a0fc7306d2aa9161" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43345 } } peers { permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 } } }
I20260806 16:57:04.669068 9490 tablet_replica.cc:442] T 0f8bcddd31b24ae19c9e0652b8783ecc P fdc24582d8954ad6a0fc7306d2aa9161: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:04.674746 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.670622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56932 (local address 127.7.153.2:43345)
0806 16:57:04.670742 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.670745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.670758 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:04.670907 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.670909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.670960 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.671051 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:04.671310 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.671917 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.673117 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.673328 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.673410 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.673747 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.674276 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.674378 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.674503 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.674558 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 16:57:04.687268 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.683483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:43313 (local address 127.7.153.1:37709)
0806 16:57:04.683679 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.683684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.683876 (+ 192us) server_negotiation.cc:407] Connection header received
0806 16:57:04.684064 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.684067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.684121 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.684202 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:04.684491 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.685079 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.686046 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.686268 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.686381 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.686772 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.686851 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.686932 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.687057 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.687110 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 16:57:04.687542 9538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.683336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37709 (local address 127.7.153.2:43313)
0806 16:57:04.683772 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.683784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.683939 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.684225 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.684228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.684236 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:04.684376 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.684382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.685191 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.685196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.685914 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.685923 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.686389 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.686393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.686559 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.686613 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.686947 (+ 334us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.686954 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.687041 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.687130 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":109,"threads_started":1}
I20260806 16:57:04.701089 9116 raft_consensus.cc:1261] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Refusing update from remote peer fdc24582d8954ad6a0fc7306d2aa9161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:04.701125 9408 raft_consensus.cc:1261] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Refusing update from remote peer fdc24582d8954ad6a0fc7306d2aa9161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:04.701756 9490 consensus_queue.cc:1035] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470e7bda0bce4e71a2f8bf3380274e88" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:04.702227 9515 consensus_queue.cc:1035] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba3af81b4f648a6b40662d6ac83d8e1" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:04.730572 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.725865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:33641 (local address 127.7.153.2:43345)
0806 16:57:04.725983 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.725987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.726002 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:04.726057 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.726060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.726113 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.726196 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:04.726526 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.727333 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.729404 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.729648 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.729738 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.730108 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.730188 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.730250 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.730390 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.730444 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 16:57:04.730640 9543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.725474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:43345 (local address 127.7.153.1:33641)
0806 16:57:04.725826 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:04.725843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:04.725948 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:04.726217 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:04.726219 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:04.726225 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:04.726403 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.726410 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.727474 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.727477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.729263 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:04.729277 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.729769 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.729772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:04.729881 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.729953 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:04.730284 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:04.730291 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 16:57:04.730359 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 16:57:04.730450 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":120,"threads_started":1}
I20260806 16:57:04.763486 8950 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:04.763702 8950 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:04.766589 8950 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f1f82afc59aa41268350df1c37749400: Sending DeleteTablet for 3 replicas of tablet 9487f5a3c1454fd4a28936fd4c81f325
I20260806 16:57:04.767483 9242 tablet_service.cc:1514] Processing DeleteTablet for tablet 9487f5a3c1454fd4a28936fd4c81f325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:04 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:56928
I20260806 16:57:04.767517 9388 tablet_service.cc:1514] Processing DeleteTablet for tablet 9487f5a3c1454fd4a28936fd4c81f325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:04 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40912
I20260806 16:57:04.767741 9506 tablet_replica.cc:330] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: stopping tablet replica
I20260806 16:57:04.767874 9506 raft_consensus.cc:2229] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:04.768282 9506 raft_consensus.cc:2258] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:04.768496 9507 tablet_replica.cc:330] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: stopping tablet replica
I20260806 16:57:04.768620 9507 raft_consensus.cc:2229] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:04.768805 9507 raft_consensus.cc:2258] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:04.769307 9506 ts_tablet_manager.cc:1905] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:04.769775 9507 ts_tablet_manager.cc:1905] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:04.772533 9506 ts_tablet_manager.cc:1918] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:04.772630 9506 log.cc:1196] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/9487f5a3c1454fd4a28936fd4c81f325
I20260806 16:57:04.772943 9506 ts_tablet_manager.cc:1939] T 9487f5a3c1454fd4a28936fd4c81f325 P fdc24582d8954ad6a0fc7306d2aa9161: Deleting consensus metadata
I20260806 16:57:04.773331 9096 tablet_service.cc:1514] Processing DeleteTablet for tablet 9487f5a3c1454fd4a28936fd4c81f325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:04 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:52890
I20260806 16:57:04.773626 9508 tablet_replica.cc:330] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: stopping tablet replica
I20260806 16:57:04.773764 9508 raft_consensus.cc:2229] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:04.773886 9508 raft_consensus.cc:2258] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:04.774394 8938 catalog_manager.cc:4841] TS fdc24582d8954ad6a0fc7306d2aa9161 (127.7.153.2:43345): tablet 9487f5a3c1454fd4a28936fd4c81f325 (table test-table [id=31baa2fc17ad4c2f81dde1fb624f2e89]) successfully deleted
I20260806 16:57:04.775290 9508 ts_tablet_manager.cc:1905] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:04.778411 9507 ts_tablet_manager.cc:1918] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:04.778630 9507 log.cc:1196] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/9487f5a3c1454fd4a28936fd4c81f325
I20260806 16:57:04.778832 9508 ts_tablet_manager.cc:1918] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:04.778927 9508 log.cc:1196] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/9487f5a3c1454fd4a28936fd4c81f325
I20260806 16:57:04.779121 9507 ts_tablet_manager.cc:1939] T 9487f5a3c1454fd4a28936fd4c81f325 P 470e7bda0bce4e71a2f8bf3380274e88: Deleting consensus metadata
I20260806 16:57:04.779286 9508 ts_tablet_manager.cc:1939] T 9487f5a3c1454fd4a28936fd4c81f325 P 3ba3af81b4f648a6b40662d6ac83d8e1: Deleting consensus metadata
I20260806 16:57:04.780144 8936 catalog_manager.cc:4841] TS 470e7bda0bce4e71a2f8bf3380274e88 (127.7.153.3:36959): tablet 9487f5a3c1454fd4a28936fd4c81f325 (table test-table [id=31baa2fc17ad4c2f81dde1fb624f2e89]) successfully deleted
I20260806 16:57:04.780293 8937 catalog_manager.cc:4841] TS 3ba3af81b4f648a6b40662d6ac83d8e1 (127.7.153.1:37709): tablet 9487f5a3c1454fd4a28936fd4c81f325 (table test-table [id=31baa2fc17ad4c2f81dde1fb624f2e89]) successfully deleted
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[8905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035424, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:04.795583 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.781063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.7.153.1:37709)
0806 16:57:04.781185 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.781190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.781568 (+ 378us) server_negotiation.cc:407] Connection header received
0806 16:57:04.781746 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.781749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.781801 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.781912 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:04.783007 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.783830 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.785205 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.785561 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.785639 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.790184 (+ 4545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:04.790197 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:04.790217 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:04.790256 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:04.793104 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.793746 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.793753 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.793755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.793858 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.794208 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.794211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.794213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.794645 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:04.794870 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.795156 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.795295 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 16:57:04.796450 9156 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52910
I20260806 16:57:04.809679 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:04.798734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54022 (local address 127.7.153.62:42707)
0806 16:57:04.798886 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:04.798891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:04.799368 (+ 477us) server_negotiation.cc:407] Connection header received
0806 16:57:04.799498 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:04.799501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:04.799562 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:04.799672 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:04.800514 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.801411 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.802627 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:04.802989 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:04.803119 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:04.805047 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:04.805051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:04.805054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:04.805088 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:04.807362 (+ 2274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.808006 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.808010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.808012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.808178 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:04.808530 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:04.808534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:04.808536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:04.808882 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:04.809031 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:04.809343 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 16:57:04.809483 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 16:57:04.810360 8950 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022
I20260806 16:57:04.812012 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9027
I20260806 16:57:04.828362 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9173
I20260806 16:57:04.837500 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9319
I20260806 16:57:04.847115 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 8919
2026-08-06T16:57:04Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3068 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[9554](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[9554](info): set up 2 sockets
Aug 06 16:57:04 dist-test-slave-cbsf krb5kdc[9554](info): commencing operation
krb5kdc: starting...
W20260806 16:57:05.945799 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:06.082194 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42151
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:06.206799 9569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:06.207130 9569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:06.207175 9569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:06.211347 9569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:06.211424 9569 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 16:57:06.211447 9569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:06.211465 9569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:06.211483 9569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:06.211498 9569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:06.217314 9569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42151
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:06.218564 9569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:06.219641 9569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:06.229027 9577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:06.229053 9575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:06.229059 9574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:06.229244 9569 server_base.cc:1034] running on GCE node
I20260806 16:57:06.230268 9569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:06.231573 9569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:06.232823 9569 hybrid_clock.cc:648] HybridClock initialized: now 1786035426232798 us; error 42 us; skew 500 ppm
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:06.241726 9569 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:06.242825 9569 webserver.cc:460] Webserver started at http://127.7.153.62:33307/ using document root <none> and password file <none>
I20260806 16:57:06.243449 9569 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:06.243515 9569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:06.243716 9569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:06.246073 9569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "856b2ffa6e0e406a9b7975c85c87ec14"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "e41350b493b57aa4912077fa287ac767"
server_key_iv: "3d75cc4680d378f576b9e3b6b58cf2c4"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.246668 9569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "856b2ffa6e0e406a9b7975c85c87ec14"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "e41350b493b57aa4912077fa287ac767"
server_key_iv: "3d75cc4680d378f576b9e3b6b58cf2c4"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.251430 9569 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 16:57:06.254323 9584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:06.255749 9569 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:57:06.255918 9569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "856b2ffa6e0e406a9b7975c85c87ec14"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "e41350b493b57aa4912077fa287ac767"
server_key_iv: "3d75cc4680d378f576b9e3b6b58cf2c4"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.256057 9569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:06.282529 9569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:06.286597 9569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:06.286849 9569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:06.297457 9569 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42151
I20260806 16:57:06.297514 9649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42151 every 8 connection(s)
I20260806 16:57:06.299083 9569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:06.301127 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9569
I20260806 16:57:06.301275 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:06.301645 7780 external_mini_cluster.cc:1428] Setting key ce397a9eb99f508ebb0a5dd00250ed4d
I20260806 16:57:06.303602 9650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:06.313014 9650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Bootstrap starting.
I20260806 16:57:06.316104 9650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:06.317543 9650 log.cc:824] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:06.317679 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.303307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59046 (local address 127.7.153.62:42151)
0806 16:57:06.303806 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:06.303827 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:06.303872 (+ 45us) server_negotiation.cc:407] Connection header received
0806 16:57:06.304803 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:06.304822 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:06.305209 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:06.305567 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:06.306413 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.307461 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.308406 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.308975 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.309154 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.311835 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:06.311842 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:06.311861 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:06.311916 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:06.314173 (+ 2257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.314683 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.314689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.314696 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.314864 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.315128 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.315131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.315132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.315702 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:06.315898 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:06.316159 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 16:57:06.316503 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":175,"threads_started":1}
I20260806 16:57:06.319685 9650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: No bootstrap required, opened a new log
I20260806 16:57:06.323069 9650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42151 } }
I20260806 16:57:06.323393 9650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:06.323483 9650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856b2ffa6e0e406a9b7975c85c87ec14, State: Initialized, Role: FOLLOWER
I20260806 16:57:06.323941 9650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42151 } }
I20260806 16:57:06.324105 9650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:06.324193 9650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:06.324306 9650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:06.325706 9650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42151 } }
I20260806 16:57:06.326035 9650 leader_election.cc:302] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 856b2ffa6e0e406a9b7975c85c87ec14; no voters:
I20260806 16:57:06.326347 9650 leader_election.cc:288] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:06.326488 9656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:06.326764 9656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [term 1 LEADER]: Becoming Leader. State: Replica: 856b2ffa6e0e406a9b7975c85c87ec14, State: Running, Role: LEADER
I20260806 16:57:06.327143 9656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42151 } }
I20260806 16:57:06.327677 9650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:06.329102 9658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 856b2ffa6e0e406a9b7975c85c87ec14. Latest consensus state: current_term: 1 leader_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42151 } } }
I20260806 16:57:06.329246 9658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:06.329524 9657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856b2ffa6e0e406a9b7975c85c87ec14" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42151 } } }
I20260806 16:57:06.329695 9657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14 [sys.catalog]: This master's current role is: LEADER
W20260806 16:57:06.333484 9671 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:06.333576 9671 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:06.333669 9665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:06.334533 9665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:06.340682 9665 catalog_manager.cc:1347] Generated new cluster ID: 0396da6ef68546b1b56ed184f31fc55b
I20260806 16:57:06.340808 9665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:06.363152 9665 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:06.364555 9665 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:06.380275 9665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Generated new TSK 0
I20260806 16:57:06.381199 9665 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:06.419638 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42151
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:06.572300 9677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:06.572636 9677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:06.572750 9677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:06.576952 9677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:06.577031 9677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:06.577075 9677 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 16:57:06.577090 9677 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:06.577185 9677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:06.583340 9677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:06.584641 9677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:06.585788 9677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:57:06.596237 9677 server_base.cc:1034] running on GCE node
W20260806 16:57:06.596182 9684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:06.596210 9685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:06.596182 9687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:06.597002 9677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:06.597805 9677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:06.599004 9677 hybrid_clock.cc:648] HybridClock initialized: now 1786035426598985 us; error 32 us; skew 500 ppm
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:06.606194 9677 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:06.607304 9677 webserver.cc:460] Webserver started at http://127.7.153.1:40995/ using document root <none> and password file <none>
I20260806 16:57:06.607959 9677 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:06.608058 9677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:06.608317 9677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:06.610692 9677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "3d80cdb1e64141099b1e50695a7ee7ca"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "e80778c6605be04b91c76f4b05827ffe"
server_key_iv: "c746e1a791d68a2096523e48e8ddc8dc"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.611316 9677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "3d80cdb1e64141099b1e50695a7ee7ca"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "e80778c6605be04b91c76f4b05827ffe"
server_key_iv: "c746e1a791d68a2096523e48e8ddc8dc"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.615675 9677 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:06.618872 9694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:06.620263 9677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260806 16:57:06.620443 9677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "3d80cdb1e64141099b1e50695a7ee7ca"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "e80778c6605be04b91c76f4b05827ffe"
server_key_iv: "c746e1a791d68a2096523e48e8ddc8dc"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.620594 9677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:06.634332 9677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:06.637650 9677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:06.637873 9677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:06.639554 9677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:06.639638 9677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:06.639712 9677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:06.639751 9677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:06.651790 9677 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:44773
I20260806 16:57:06.651809 9818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:44773 every 8 connection(s)
I20260806 16:57:06.653172 9677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:06.655429 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.640494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:49187 (local address 127.7.153.62:42151)
0806 16:57:06.640680 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:06.640687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:06.641659 (+ 972us) server_negotiation.cc:407] Connection header received
0806 16:57:06.642817 (+ 1158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:06.642824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:06.642901 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:06.643015 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:06.644934 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.645503 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.646772 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.647069 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.647190 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.650721 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:06.650724 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:06.650727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:06.650757 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:06.652869 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.653516 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.653523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.653524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.653648 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.654306 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.654309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.654311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.654564 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:06.654662 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:06.655163 (+ 501us) server_negotiation.cc:299] Negotiation successful
0806 16:57:06.655293 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 16:57:06.656277 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.640981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.7.153.1:49187)
0806 16:57:06.641469 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:06.641525 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:06.642535 (+ 1010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:06.643341 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:06.643348 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:06.643838 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:06.644738 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.644761 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.645651 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.645655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.646634 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.646644 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.647281 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.647287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.647506 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.648204 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:06.648226 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:06.650487 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:06.653020 (+ 2533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.653026 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.653040 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.653366 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.653952 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.653959 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.653962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.654148 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.654665 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:06.654671 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:06.654938 (+ 267us) client_negotiation.cc:769] Sending connection context
0806 16:57:06.655100 (+ 162us) client_negotiation.cc:240] Negotiation successful
0806 16:57:06.655387 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":142,"threads_started":1}
I20260806 16:57:06.657639 9819 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42151
I20260806 16:57:06.657912 9819 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:06.658470 9819 heartbeater.cc:511] Master 127.7.153.62:42151 requested a full tablet report, sending...
I20260806 16:57:06.659492 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9677
I20260806 16:57:06.659628 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:06.659966 7780 external_mini_cluster.cc:1428] Setting key c22d52ec4a71ca61bbed45612fa855d4
I20260806 16:57:06.660310 9602 ts_manager.cc:194] Registered new tserver with Master: 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773)
I20260806 16:57:06.662102 9602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:49187
I20260806 16:57:06.669013 9825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.660588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.7.153.1:38731)
0806 16:57:06.660922 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:06.660938 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:06.661045 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:06.661296 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:06.661299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:06.661551 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:06.661692 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.661700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.662705 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.662711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.663527 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.663539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.664191 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.664194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.664296 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.665003 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:06.665015 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:06.665382 (+ 367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:06.667269 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.667273 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.667275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.667492 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.667815 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.667818 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.667820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.667909 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.668342 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:06.668345 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:06.668451 (+ 106us) client_negotiation.cc:769] Sending connection context
0806 16:57:06.668560 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 16:57:06.668816 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":19,"thread_start_us":138,"threads_started":1}
I20260806 16:57:06.669004 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.660636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38731 (local address 127.7.153.62:42151)
0806 16:57:06.660805 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:06.660811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:06.661015 (+ 204us) server_negotiation.cc:407] Connection header received
0806 16:57:06.661128 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:06.661131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:06.661174 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:06.661257 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:06.661810 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.662550 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.663669 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.664063 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.664182 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.665531 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:06.665535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:06.665538 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:06.665564 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:06.667062 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.667601 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.667605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.667607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.667707 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.668006 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.668009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.668011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.668222 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:06.668341 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:06.668619 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 16:57:06.668806 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":82}
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:06.690155 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42151
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:06.816891 9828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:06.817387 9828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:06.817495 9828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:06.823854 9828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:06.824018 9828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:06.824112 9828 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 16:57:06.824190 9828 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:06.824270 9828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:06.831254 9828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:06.832454 9828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:06.833616 9828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:06.845112 9835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:06.845112 9838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:06.845170 9828 server_base.cc:1034] running on GCE node
W20260806 16:57:06.845112 9836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:06.845803 9828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:06.846530 9828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:06.847744 9828 hybrid_clock.cc:648] HybridClock initialized: now 1786035426847719 us; error 38 us; skew 500 ppm
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:06.851233 9828 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:06.852304 9828 webserver.cc:460] Webserver started at http://127.7.153.2:41847/ using document root <none> and password file <none>
I20260806 16:57:06.853046 9828 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:06.853154 9828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:06.853410 9828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:06.855755 9828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "75781846d5ef45408056c2d99ee4f235"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "c3f129f985776bf7cad14168d88722ed"
server_key_iv: "d1a577670b6ead9ecfd4e56e757172c4"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.856386 9828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "75781846d5ef45408056c2d99ee4f235"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "c3f129f985776bf7cad14168d88722ed"
server_key_iv: "d1a577670b6ead9ecfd4e56e757172c4"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.861516 9828 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 16:57:06.864514 9846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:06.866600 9828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 16:57:06.866804 9828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "75781846d5ef45408056c2d99ee4f235"
format_stamp: "Formatted at 2026-08-06 16:57:06 on dist-test-slave-cbsf"
server_key: "c3f129f985776bf7cad14168d88722ed"
server_key_iv: "d1a577670b6ead9ecfd4e56e757172c4"
server_key_version: "encryptionkey@0"
I20260806 16:57:06.866948 9828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:06.881560 9828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:06.885231 9828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:06.885464 9828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:06.887042 9828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:06.887126 9828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:06.887198 9828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:06.887244 9828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:06 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:06.899061 9828 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34787
I20260806 16:57:06.899123 9970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34787 every 8 connection(s)
I20260806 16:57:06.900292 9828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:06.903614 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.888067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:54937 (local address 127.7.153.62:42151)
0806 16:57:06.888198 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:06.888202 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:06.889388 (+ 1186us) server_negotiation.cc:407] Connection header received
0806 16:57:06.890969 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:06.890975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:06.891080 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:06.891199 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:06.893118 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.894036 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.895496 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.895752 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.895882 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.899595 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:06.899599 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:06.899602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:06.899639 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:06.901566 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.902166 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.902169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.902171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.902258 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.902564 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.902566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.902568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.902769 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:06.902845 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:06.903370 (+ 525us) server_negotiation.cc:299] Negotiation successful
0806 16:57:06.903485 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 16:57:06.904533 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.888674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.7.153.2:54937)
0806 16:57:06.889222 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:06.889268 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:06.890644 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:06.891428 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:06.891441 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:06.892021 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:06.892901 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.892937 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.894218 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.894222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.895312 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.895325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.895946 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.895951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.896160 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.896914 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:06.896943 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:06.899349 (+ 2406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:06.901723 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.901729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.901742 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.902048 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.902338 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.902340 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.902342 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.902479 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.902864 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:06.902870 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:06.903146 (+ 276us) client_negotiation.cc:769] Sending connection context
0806 16:57:06.903309 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 16:57:06.903583 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":135,"threads_started":1}
I20260806 16:57:06.905823 9971 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42151
I20260806 16:57:06.905985 9971 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:06.906613 9971 heartbeater.cc:511] Master 127.7.153.62:42151 requested a full tablet report, sending...
I20260806 16:57:06.907912 9601 ts_manager.cc:194] Registered new tserver with Master: 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787)
I20260806 16:57:06.908674 9601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:54937
I20260806 16:57:06.909915 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9828
I20260806 16:57:06.910049 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:06.910356 7780 external_mini_cluster.cc:1428] Setting key e9db03d3af5d41dde0fb6b42f2ad08c7
I20260806 16:57:06.917224 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.908459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:43325 (local address 127.7.153.62:42151)
0806 16:57:06.908597 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:06.908625 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:06.909004 (+ 379us) server_negotiation.cc:407] Connection header received
0806 16:57:06.909145 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:06.909148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:06.909191 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:06.909280 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:06.909804 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.910557 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.911546 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.911861 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.911947 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.913337 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:06.913340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:06.913342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:06.913364 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:06.914924 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.915534 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.915537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.915539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.915651 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:06.916034 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:06.916040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:06.916045 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:06.916375 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:06.916511 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:06.916875 (+ 364us) server_negotiation.cc:299] Negotiation successful
0806 16:57:06.917025 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 16:57:06.917256 9977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:06.908383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.7.153.2:43325)
0806 16:57:06.908903 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:06.908920 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:06.909037 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:06.909298 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:06.909301 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:06.909519 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:06.909667 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.909678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.910723 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.910727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.911393 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:06.911402 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:06.911981 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:06.911985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:06.912081 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:06.912637 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:06.912657 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:06.913193 (+ 536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:06.915057 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.915064 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.915068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.915395 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.915801 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:06.915805 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:06.915807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:06.915922 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:06.916500 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:06.916503 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:06.916626 (+ 123us) client_negotiation.cc:769] Sending connection context
0806 16:57:06.916808 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 16:57:06.917011 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:06.944259 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42151
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:07.074667 9980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:07.074985 9980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:07.075068 9980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:07.079345 9980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:07.079432 9980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:07.079478 9980 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 16:57:07.079492 9980 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:07.079579 9980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:07.085462 9980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:07.086736 9980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:07.087853 9980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:07.098579 9986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:07.098778 9985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:07.098583 9988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:07.099048 9980 server_base.cc:1034] running on GCE node
I20260806 16:57:07.099587 9980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:07.100433 9980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:07.103758 9980 hybrid_clock.cc:648] HybridClock initialized: now 1786035427103630 us; error 145 us; skew 500 ppm
Aug 06 16:57:07 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035427, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:07.107255 9980 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:07.108418 9980 webserver.cc:460] Webserver started at http://127.7.153.3:33193/ using document root <none> and password file <none>
I20260806 16:57:07.109138 9980 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:07.109215 9980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:07.109452 9980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:07.111848 9980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "5207ef480dce42788634f8c5d7dc03d2"
format_stamp: "Formatted at 2026-08-06 16:57:07 on dist-test-slave-cbsf"
server_key: "977625e3e778fc3623154877699f330f"
server_key_iv: "4a9afe1e288164fbc444316adc2c7d62"
server_key_version: "encryptionkey@0"
I20260806 16:57:07.112488 9980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "5207ef480dce42788634f8c5d7dc03d2"
format_stamp: "Formatted at 2026-08-06 16:57:07 on dist-test-slave-cbsf"
server_key: "977625e3e778fc3623154877699f330f"
server_key_iv: "4a9afe1e288164fbc444316adc2c7d62"
server_key_version: "encryptionkey@0"
I20260806 16:57:07.116993 9980 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:57:07.119810 9995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:07.121343 9980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:07.121498 9980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "5207ef480dce42788634f8c5d7dc03d2"
format_stamp: "Formatted at 2026-08-06 16:57:07 on dist-test-slave-cbsf"
server_key: "977625e3e778fc3623154877699f330f"
server_key_iv: "4a9afe1e288164fbc444316adc2c7d62"
server_key_version: "encryptionkey@0"
I20260806 16:57:07.121628 9980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:07.134265 9980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:07.137804 9980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:07.138034 9980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:07.139976 9980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:07.140040 9980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:07.140085 9980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:07.140126 9980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:07 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035427, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:07.151991 9980 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:33343
I20260806 16:57:07.152063 10118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:33343 every 8 connection(s)
I20260806 16:57:07.153129 9980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:07.154739 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.140828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:50575 (local address 127.7.153.62:42151)
0806 16:57:07.140989 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.140994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.141945 (+ 951us) server_negotiation.cc:407] Connection header received
0806 16:57:07.143156 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.143165 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.143250 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.143335 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:07.144907 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.145595 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.146883 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.147163 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.147280 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.150393 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:07.150396 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:07.150398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:07.150427 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:07.152207 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.152808 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.152812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.152814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.152920 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.153309 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.153312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.153314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.153602 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:07.153724 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.154472 (+ 748us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.154596 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 16:57:07.155596 10004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.141292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.7.153.3:50575)
0806 16:57:07.141754 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.141807 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.142867 (+ 1060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.143758 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.143770 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.144178 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:07.144742 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.144758 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.145736 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.145740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.146751 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.146761 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.147345 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.147349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.147523 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.148219 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:07.148248 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:07.150175 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:07.152345 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:07.152351 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:07.152368 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:07.152654 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:07.153013 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:07.153017 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:07.153019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:07.153181 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:07.153784 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:07.153790 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:07.154171 (+ 381us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.154380 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.154670 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":119,"threads_started":1}
I20260806 16:57:07.157052 10120 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42151
I20260806 16:57:07.157217 10120 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:07.157779 10120 heartbeater.cc:511] Master 127.7.153.62:42151 requested a full tablet report, sending...
I20260806 16:57:07.159138 9602 ts_manager.cc:194] Registered new tserver with Master: 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:07.160015 9602 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:50575
I20260806 16:57:07.163311 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 9980
I20260806 16:57:07.163442 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:07.163738 7780 external_mini_cluster.cc:1428] Setting key bd5c0fc9cd52d61c093f625d43b51925
I20260806 16:57:07.166074 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:57:07.167418 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.159334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:49441 (local address 127.7.153.62:42151)
0806 16:57:07.160380 (+ 1046us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.160385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.160398 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:07.160435 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.160439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.160483 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.160581 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:07.161122 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.161639 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.162448 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.162691 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.162798 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.164034 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:07.164038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:07.164040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:07.164065 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:07.165629 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.166167 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.166171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.166173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.166258 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.166542 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.166545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.166547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.166763 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:07.166874 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.167137 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.167254 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975}
I20260806 16:57:07.167439 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.159272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.7.153.3:49441)
0806 16:57:07.159565 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.159581 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.159687 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.160600 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.160603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.160883 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:07.161003 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.161009 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.161767 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.161771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.162328 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.162335 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.162805 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.162808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.162903 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.163466 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:07.163485 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:07.163901 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:07.165748 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:07.165752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:07.165754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:07.166041 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:07.166350 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:07.166354 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:07.166356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:07.166446 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:07.166864 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:07.166867 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:07.166974 (+ 107us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.167079 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.167257 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":9,"thread_start_us":104,"threads_started":1}
Aug 06 16:57:07 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 16:57:07 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:07.196115 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.187166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59048 (local address 127.7.153.62:42151)
0806 16:57:07.187310 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.187314 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.187327 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:07.187369 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.187372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.187410 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.187505 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:07.188287 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.188904 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.189765 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.189994 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.190122 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.192643 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:07.192653 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:07.192655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:07.192687 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:07.194293 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.194759 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.194762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.194763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.194850 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.195156 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.195159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.195160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.195369 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:07.195480 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.195701 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.195813 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 16:57:07.199644 9602 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:07.202935 9602 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:07.219947 10141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.213525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44773 (local address 127.0.0.1:50866)
0806 16:57:07.214797 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.214811 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.214905 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.215596 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.215599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.215611 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:07.215940 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.215946 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.216969 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.216972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.218346 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.218356 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.219302 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.219305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.219427 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.219475 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.219607 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.219744 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1210,"mutex_wait_us":261,"spinlock_wait_cycles":8064,"thread_start_us":108,"threads_started":1}
I20260806 16:57:07.219942 10140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.214203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50866 (local address 127.7.153.1:44773)
0806 16:57:07.215158 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.215167 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.215191 (+ 24us) server_negotiation.cc:407] Connection header received
0806 16:57:07.215266 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.215270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.215427 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.215683 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:07.216056 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.216853 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.218473 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.219167 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.219284 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.219447 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.219656 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.219776 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":101,"threads_started":1}
I20260806 16:57:07.220311 10138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.213489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:33343 (local address 127.0.0.1:38446)
0806 16:57:07.214403 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.214462 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.214630 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.215561 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.215570 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.215599 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:07.215785 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.215796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.217364 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.217369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.218813 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.218825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.219878 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.219881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.219994 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.220021 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.220079 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.220166 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"mutex_wait_us":165,"spinlock_wait_cycles":3456,"thread_start_us":121,"threads_started":1}
I20260806 16:57:07.220312 10137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.214312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34787 (local address 127.0.0.1:38382)
0806 16:57:07.214877 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.214893 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.214975 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.215646 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.215649 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.215668 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:07.215796 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.215801 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.217378 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.217381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.218813 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.218825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.219883 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.219887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.219999 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.220032 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.220088 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.220190 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":65,"thread_start_us":98,"threads_started":1}
I20260806 16:57:07.220912 10142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.214763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38382 (local address 127.7.153.2:34787)
0806 16:57:07.215219 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.215231 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.215251 (+ 20us) server_negotiation.cc:407] Connection header received
0806 16:57:07.215318 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.215322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.215481 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.215957 (+ 476us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:07.216093 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.217245 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.218972 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.219748 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.220383 (+ 635us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.220577 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.220635 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.220757 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":117,"threads_started":1}
I20260806 16:57:07.221438 10139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.213671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38446 (local address 127.7.153.3:33343)
0806 16:57:07.214015 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.214041 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.214570 (+ 529us) server_negotiation.cc:407] Connection header received
0806 16:57:07.215132 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.215138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.215368 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.215545 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:07.215924 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.217211 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.218957 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.219736 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.220963 (+ 1227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.221135 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.221187 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.221283 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":134,"threads_started":1}
I20260806 16:57:07.223657 9750 tablet_service.cc:1467] Processing CreateTablet for tablet eb8a6c4c96814703994d981ed4df4962 (DEFAULT_TABLE table=test-table [id=11367498d43049208e892de5b1111c94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:07.223888 9901 tablet_service.cc:1467] Processing CreateTablet for tablet eb8a6c4c96814703994d981ed4df4962 (DEFAULT_TABLE table=test-table [id=11367498d43049208e892de5b1111c94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:07.224326 10050 tablet_service.cc:1467] Processing CreateTablet for tablet eb8a6c4c96814703994d981ed4df4962 (DEFAULT_TABLE table=test-table [id=11367498d43049208e892de5b1111c94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:07.224988 9750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb8a6c4c96814703994d981ed4df4962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.225030 9901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb8a6c4c96814703994d981ed4df4962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.225358 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb8a6c4c96814703994d981ed4df4962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.232396 10143 tablet_bootstrap.cc:492] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Bootstrap starting.
I20260806 16:57:07.234195 10145 tablet_bootstrap.cc:492] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Bootstrap starting.
I20260806 16:57:07.234863 10143 tablet_bootstrap.cc:654] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.235634 10143 log.cc:824] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:07.236112 10145 tablet_bootstrap.cc:654] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.237056 10145 log.cc:824] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:07.238097 10143 tablet_bootstrap.cc:492] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: No bootstrap required, opened a new log
I20260806 16:57:07.238313 10143 ts_tablet_manager.cc:1397] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 16:57:07.238942 10145 tablet_bootstrap.cc:492] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: No bootstrap required, opened a new log
I20260806 16:57:07.239157 10145 ts_tablet_manager.cc:1397] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 16:57:07.240880 10144 tablet_bootstrap.cc:492] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Bootstrap starting.
I20260806 16:57:07.242465 10145 raft_consensus.cc:348] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.242743 10145 raft_consensus.cc:374] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.242574 10143 raft_consensus.cc:348] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.242817 10145 raft_consensus.cc:729] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5207ef480dce42788634f8c5d7dc03d2, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.242883 10143 raft_consensus.cc:374] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.242961 10143 raft_consensus.cc:729] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.243391 10145 consensus_queue.cc:260] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.243429 10143 consensus_queue.cc:260] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.243603 10144 tablet_bootstrap.cc:654] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.244175 10120 heartbeater.cc:503] Master 127.7.153.62:42151 was elected leader, sending a full tablet report...
I20260806 16:57:07.244583 10144 log.cc:824] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:07.244640 10145 ts_tablet_manager.cc:1428] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 16:57:07.245118 10143 ts_tablet_manager.cc:1428] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 16:57:07.245267 9819 heartbeater.cc:503] Master 127.7.153.62:42151 was elected leader, sending a full tablet report...
I20260806 16:57:07.246951 10144 tablet_bootstrap.cc:492] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: No bootstrap required, opened a new log
I20260806 16:57:07.247215 10144 ts_tablet_manager.cc:1397] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260806 16:57:07.251068 10144 raft_consensus.cc:348] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.251329 10144 raft_consensus.cc:374] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.251390 10144 raft_consensus.cc:729] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.251907 10144 consensus_queue.cc:260] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.252748 9971 heartbeater.cc:503] Master 127.7.153.62:42151 was elected leader, sending a full tablet report...
I20260806 16:57:07.253160 10144 ts_tablet_manager.cc:1428] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260806 16:57:07.386272 10151 raft_consensus.cc:482] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:07.386579 10151 raft_consensus.cc:504] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.387894 10151 leader_election.cc:288] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343), 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787)
I20260806 16:57:07.392055 10142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.388378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:55041 (local address 127.7.153.2:34787)
0806 16:57:07.388523 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.388530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.388719 (+ 189us) server_negotiation.cc:407] Connection header received
0806 16:57:07.388911 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.388913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.388961 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.389049 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:07.389336 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.389871 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.391050 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.391456 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.391584 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.391654 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.391838 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.391911 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:57:07.392081 10154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.388232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34787 (local address 127.7.153.1:55041)
0806 16:57:07.388594 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.388614 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.388773 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.389064 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.389067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.389085 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:07.389222 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.389228 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.390003 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.390006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.390908 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.390919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.391597 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.391600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.391702 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.391726 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.391821 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.391902 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":23,"thread_start_us":133,"threads_started":1}
I20260806 16:57:07.392192 10139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.388365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:47639 (local address 127.7.153.3:33343)
0806 16:57:07.388531 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.388535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.388993 (+ 458us) server_negotiation.cc:407] Connection header received
0806 16:57:07.389159 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.389162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.389214 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.389297 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:07.389569 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.390089 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.391192 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.391603 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.391724 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.391789 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.391981 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.392054 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 16:57:07.392457 10155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.388232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:33343 (local address 127.7.153.1:47639)
0806 16:57:07.388891 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.388904 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.389034 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.389309 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.389312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.389327 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:07.389447 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.389453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.390211 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.390217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.391064 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.391074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.391731 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.391735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.391857 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.391876 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.391962 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.392033 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":373,"thread_start_us":147,"threads_started":1}
I20260806 16:57:07.392879 9921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb8a6c4c96814703994d981ed4df4962" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75781846d5ef45408056c2d99ee4f235" is_pre_election: true
I20260806 16:57:07.393123 10070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb8a6c4c96814703994d981ed4df4962" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2" is_pre_election: true
I20260806 16:57:07.393258 9921 raft_consensus.cc:2454] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 0.
I20260806 16:57:07.393414 10070 raft_consensus.cc:2454] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 0.
I20260806 16:57:07.393776 9696 leader_election.cc:302] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:07.394198 10151 raft_consensus.cc:2781] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:07.394366 10151 raft_consensus.cc:482] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:07.394402 10151 raft_consensus.cc:3037] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.396090 10151 raft_consensus.cc:504] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
I20260806 16:57:07.396497 10151 leader_election.cc:288] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 election: Requested vote from peers 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343), 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787)
I20260806 16:57:07.396994 10070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb8a6c4c96814703994d981ed4df4962" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2"
I20260806 16:57:07.396994 9921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb8a6c4c96814703994d981ed4df4962" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75781846d5ef45408056c2d99ee4f235"
I20260806 16:57:07.397147 10070 raft_consensus.cc:3037] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.397148 9921 raft_consensus.cc:3037] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.398730 9921 raft_consensus.cc:2454] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 1.
I20260806 16:57:07.399078 10070 raft_consensus.cc:2454] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 1.
I20260806 16:57:07.399247 9696 leader_election.cc:302] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:07.399456 10151 raft_consensus.cc:2781] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:07.399739 10151 raft_consensus.cc:686] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 LEADER]: Becoming Leader. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Running, Role: LEADER
I20260806 16:57:07.400169 10151 consensus_queue.cc:237] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } }
W20260806 16:57:07.401651 9972 tablet.cc:2369] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:07.403992 9602 catalog_manager.cc:5495] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1). New cstate: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } health_report { overall_health: UNKNOWN } } }
W20260806 16:57:07.404374 10121 tablet.cc:2369] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:57:07.405256 9820 tablet.cc:2369] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 16:57:07 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035426, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:07.480278 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.470722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42151 (local address 127.0.0.1:59064)
0806 16:57:07.471076 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.471097 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.471240 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.471533 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.471536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.472090 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:07.472194 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.472202 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.473044 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.473049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.473623 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.473631 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.474091 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.474095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.474227 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.474876 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:07.474889 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:07.476532 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:07.478524 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:07.478539 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:07.478548 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:07.478806 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:07.479104 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:07.479109 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:07.479111 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:07.479196 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:07.479608 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:07.479619 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:07.479739 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.479861 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.480064 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":34,"thread_start_us":144,"threads_started":1}
I20260806 16:57:07.480275 9654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.470864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59064 (local address 127.7.153.62:42151)
0806 16:57:07.471028 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.471033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.471176 (+ 143us) server_negotiation.cc:407] Connection header received
0806 16:57:07.471354 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.471361 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.471398 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.471482 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:07.472328 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.472924 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.473747 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.473958 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.474075 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.476721 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:07.476727 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:07.476732 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:07.476758 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:07.478376 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.478914 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.478919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.478921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.479013 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:07.479282 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:07.479287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:07.479289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:07.479493 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:07.479608 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.479909 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.480124 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":106,"server-negotiator.queue_time_us":50}
I20260806 16:57:07.485237 9602 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:59064:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 16:57:07.486397 9602 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:07.491794 10050 tablet_service.cc:1467] Processing CreateTablet for tablet 4075a90519f1407e9fb96b399f401d49 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4695d6bfe7d4f2e91a90a708781a858]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:07.491762 9750 tablet_service.cc:1467] Processing CreateTablet for tablet 4075a90519f1407e9fb96b399f401d49 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4695d6bfe7d4f2e91a90a708781a858]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:07.491765 9901 tablet_service.cc:1467] Processing CreateTablet for tablet 4075a90519f1407e9fb96b399f401d49 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4695d6bfe7d4f2e91a90a708781a858]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:07.492597 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4075a90519f1407e9fb96b399f401d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.492597 9750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4075a90519f1407e9fb96b399f401d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.492609 9901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4075a90519f1407e9fb96b399f401d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.495535 10144 tablet_bootstrap.cc:492] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: Bootstrap starting.
I20260806 16:57:07.495729 10143 tablet_bootstrap.cc:492] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: Bootstrap starting.
I20260806 16:57:07.496249 10145 tablet_bootstrap.cc:492] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: Bootstrap starting.
I20260806 16:57:07.496584 10144 tablet_bootstrap.cc:654] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.497139 10143 tablet_bootstrap.cc:654] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.497375 10145 tablet_bootstrap.cc:654] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.498523 10144 tablet_bootstrap.cc:492] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: No bootstrap required, opened a new log
I20260806 16:57:07.498550 10143 tablet_bootstrap.cc:492] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: No bootstrap required, opened a new log
I20260806 16:57:07.498605 10144 ts_tablet_manager.cc:1397] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:07.498657 10143 ts_tablet_manager.cc:1397] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:07.499085 10144 raft_consensus.cc:348] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.499274 10144 raft_consensus.cc:374] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.499205 10143 raft_consensus.cc:348] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.499320 10144 raft_consensus.cc:729] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.499356 10143 raft_consensus.cc:374] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.499393 10143 raft_consensus.cc:729] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.499469 10144 consensus_queue.cc:260] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.499516 10143 consensus_queue.cc:260] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.499758 10144 ts_tablet_manager.cc:1428] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:07.499802 10143 ts_tablet_manager.cc:1428] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:07.499794 10151 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.499949 10151 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.500120 10153 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.500239 10153 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.500919 10145 tablet_bootstrap.cc:492] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: No bootstrap required, opened a new log
I20260806 16:57:07.501044 10145 ts_tablet_manager.cc:1397] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260806 16:57:07.501588 10145 raft_consensus.cc:348] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.501744 10145 raft_consensus.cc:374] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.501785 10145 raft_consensus.cc:729] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5207ef480dce42788634f8c5d7dc03d2, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.502329 10145 consensus_queue.cc:260] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.502678 10145 ts_tablet_manager.cc:1428] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 16:57:07.502653 10150 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.502804 10150 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.670403 10151 raft_consensus.cc:482] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:07.670596 10151 raft_consensus.cc:504] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.671082 10151 leader_election.cc:288] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:07.671684 10070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4075a90519f1407e9fb96b399f401d49" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2" is_pre_election: true
I20260806 16:57:07.671686 9921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4075a90519f1407e9fb96b399f401d49" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75781846d5ef45408056c2d99ee4f235" is_pre_election: true
I20260806 16:57:07.671860 10070 raft_consensus.cc:2454] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 0.
I20260806 16:57:07.671872 9921 raft_consensus.cc:2454] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 0.
I20260806 16:57:07.672175 9696 leader_election.cc:302] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:07.672370 10151 raft_consensus.cc:2781] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:07.672428 10151 raft_consensus.cc:482] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:07.672456 10151 raft_consensus.cc:3037] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.673578 10151 raft_consensus.cc:504] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.673928 10151 leader_election.cc:288] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 election: Requested vote from peers 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:07.674381 10070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4075a90519f1407e9fb96b399f401d49" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2"
I20260806 16:57:07.674381 9921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4075a90519f1407e9fb96b399f401d49" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75781846d5ef45408056c2d99ee4f235"
I20260806 16:57:07.674520 10070 raft_consensus.cc:3037] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.674525 9921 raft_consensus.cc:3037] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.675523 10070 raft_consensus.cc:2454] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 1.
I20260806 16:57:07.675537 9921 raft_consensus.cc:2454] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 1.
I20260806 16:57:07.675890 9698 leader_election.cc:302] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 5207ef480dce42788634f8c5d7dc03d2; no voters:
I20260806 16:57:07.676091 10151 raft_consensus.cc:2781] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:07.676208 10151 raft_consensus.cc:686] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 LEADER]: Becoming Leader. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Running, Role: LEADER
I20260806 16:57:07.676360 10151 consensus_queue.cc:237] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.677191 10156 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: TxnStatusTablet state changed. Reason: New leader 3d80cdb1e64141099b1e50695a7ee7ca. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.677320 10156 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:07.677654 10168 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 16:57:07.677937 10168 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 16:57:07.678404 9601 catalog_manager.cc:5495] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1). New cstate: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:07.694541 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.690157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44773 (local address 127.0.0.1:50876)
0806 16:57:07.690318 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.690335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.690447 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.690781 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.690783 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.690789 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:07.690885 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.690889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.691936 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.691939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.692584 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.692593 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.693223 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.693226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.693296 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.693354 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:07.694231 (+ 877us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:07.694252 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.694323 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.694414 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 16:57:07.694556 10140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.690306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.7.153.1:44773)
0806 16:57:07.690454 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.690459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.690477 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:57:07.690562 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.690565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.690651 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.690772 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:07.690995 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.691794 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.692735 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.693088 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.693194 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.693501 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:07.694104 (+ 603us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:07.694229 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.694337 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.694407 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 16:57:07.700781 10070 raft_consensus.cc:1261] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d80cdb1e64141099b1e50695a7ee7ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:07.700798 9921 raft_consensus.cc:1261] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Refusing update from remote peer 3d80cdb1e64141099b1e50695a7ee7ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:07.701588 10156 consensus_queue.cc:1035] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:07.701843 10151 consensus_queue.cc:1035] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:07.705651 10150 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: TxnStatusTablet state changed. Reason: New leader 3d80cdb1e64141099b1e50695a7ee7ca. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.705798 10150 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.705956 10153 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: TxnStatusTablet state changed. Reason: New leader 3d80cdb1e64141099b1e50695a7ee7ca. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.706076 10153 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.709210 10156 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.709357 10156 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:07.709455 10171 mvcc.cc:205] Tried to move back new op lower bound from 7315601111853895680 to 7315601111764295680. Current Snapshot: MvccSnapshot[applied={T|T < 7315601111853895680}]
I20260806 16:57:07.709728 10153 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.709841 10153 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 75781846d5ef45408056c2d99ee4f235: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.711167 10172 mvcc.cc:205] Tried to move back new op lower bound from 7315601111853895680 to 7315601111764295680. Current Snapshot: MvccSnapshot[applied={T|T < 7315601111853895680}]
I20260806 16:57:07.712054 10156 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.712189 10156 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 3d80cdb1e64141099b1e50695a7ee7ca: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:07.714046 10150 tablet_replica.cc:439] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } } }
I20260806 16:57:07.714191 10150 tablet_replica.cc:442] T 4075a90519f1407e9fb96b399f401d49 P 5207ef480dce42788634f8c5d7dc03d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:07.724385 10140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.720212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50878 (local address 127.7.153.1:44773)
0806 16:57:07.720345 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.720350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.720632 (+ 282us) server_negotiation.cc:407] Connection header received
0806 16:57:07.720807 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.720810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.720869 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.720956 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:07.721265 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.721773 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.723077 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.723306 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.723401 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.723742 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:07.723839 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:07.723914 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.724120 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.724179 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 16:57:07.737102 10140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.733543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:56243 (local address 127.7.153.1:44773)
0806 16:57:07.733672 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:07.733676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:07.733927 (+ 251us) server_negotiation.cc:407] Connection header received
0806 16:57:07.734095 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:07.734107 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:07.734155 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:07.734227 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:07.734503 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.735010 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.735898 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.736112 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.736217 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.736549 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:07.736626 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:07.736699 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:07.736834 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 16:57:07.736879 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":47}
I20260806 16:57:07.737109 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:07.733434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44773 (local address 127.7.153.1:56243)
0806 16:57:07.733835 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:07.733847 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:07.733996 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:07.734246 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:07.734248 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:07.734255 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:07.734393 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.734400 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.735126 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.735130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.735779 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:07.735788 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:07.736222 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:07.736225 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:07.736326 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:07.736373 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:07.736732 (+ 359us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:07.736741 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 16:57:07.736814 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 16:57:07.736896 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":2,"thread_start_us":116,"threads_started":1}
I20260806 16:57:07.745353 10068 raft_consensus.cc:1261] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d80cdb1e64141099b1e50695a7ee7ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:07.745435 9921 raft_consensus.cc:1261] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Refusing update from remote peer 3d80cdb1e64141099b1e50695a7ee7ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:07.745818 10151 consensus_queue.cc:1035] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:07.745973 10156 consensus_queue.cc:1035] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:07.750200 10173 mvcc.cc:205] Tried to move back new op lower bound from 7315601112041295872 to 7315601110634541056. Current Snapshot: MvccSnapshot[applied={T|T < 7315601112041295872}]
I20260806 16:57:07.788007 9601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:07.788226 9601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:07.791786 9601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Sending DeleteTablet for 3 replicas of tablet eb8a6c4c96814703994d981ed4df4962
I20260806 16:57:07.792781 9749 tablet_service.cc:1514] Processing DeleteTablet for tablet eb8a6c4c96814703994d981ed4df4962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:07 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:50866
I20260806 16:57:07.792855 10050 tablet_service.cc:1514] Processing DeleteTablet for tablet eb8a6c4c96814703994d981ed4df4962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:07 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38446
I20260806 16:57:07.793416 9901 tablet_service.cc:1514] Processing DeleteTablet for tablet eb8a6c4c96814703994d981ed4df4962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:07 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38382
I20260806 16:57:07.793556 10191 tablet_replica.cc:330] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: stopping tablet replica
I20260806 16:57:07.793473 9601 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 16:57:07.793896 10191 raft_consensus.cc:2229] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 LEADER]: Raft consensus shutting down.
W20260806 16:57:07.794000 9601 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:07.794291 10190 tablet_replica.cc:330] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: stopping tablet replica
I20260806 16:57:07.794341 10191 raft_consensus.cc:2258] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:07.794656 10190 raft_consensus.cc:2229] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:07.794905 10190 raft_consensus.cc:2258] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:07.795933 10191 ts_tablet_manager.cc:1905] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:07.796237 10190 ts_tablet_manager.cc:1905] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:07.799583 10191 ts_tablet_manager.cc:1918] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:07.799611 10190 ts_tablet_manager.cc:1918] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:07.799713 10190 log.cc:1196] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/eb8a6c4c96814703994d981ed4df4962
I20260806 16:57:07.800096 9749 tablet_service.cc:1467] Processing CreateTablet for tablet 92b64a72517e40768009d0aa3de2611c (DEFAULT_TABLE table=test-table [id=888f5a4a6b1e4920aa330efe451ab271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:07.800310 9901 tablet_service.cc:1467] Processing CreateTablet for tablet 92b64a72517e40768009d0aa3de2611c (DEFAULT_TABLE table=test-table [id=888f5a4a6b1e4920aa330efe451ab271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:07.800418 9749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b64a72517e40768009d0aa3de2611c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.800426 10050 tablet_service.cc:1467] Processing CreateTablet for tablet 92b64a72517e40768009d0aa3de2611c (DEFAULT_TABLE table=test-table [id=888f5a4a6b1e4920aa330efe451ab271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:07.800593 9901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b64a72517e40768009d0aa3de2611c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.800668 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92b64a72517e40768009d0aa3de2611c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:07.803092 10143 tablet_bootstrap.cc:492] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Bootstrap starting.
I20260806 16:57:07.803186 10145 tablet_bootstrap.cc:492] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Bootstrap starting.
I20260806 16:57:07.804083 10143 tablet_bootstrap.cc:654] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.804183 10145 tablet_bootstrap.cc:654] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.804546 10192 tablet_replica.cc:330] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: stopping tablet replica
I20260806 16:57:07.804951 10192 raft_consensus.cc:2229] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:07.805002 10191 log.cc:1196] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/eb8a6c4c96814703994d981ed4df4962
I20260806 16:57:07.805248 10192 raft_consensus.cc:2258] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:07.805433 10144 tablet_bootstrap.cc:492] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Bootstrap starting.
I20260806 16:57:07.805503 10191 ts_tablet_manager.cc:1939] T eb8a6c4c96814703994d981ed4df4962 P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting consensus metadata
I20260806 16:57:07.806447 10144 tablet_bootstrap.cc:654] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:07.806783 10192 ts_tablet_manager.cc:1905] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:07.807120 9586 catalog_manager.cc:4841] TS 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773): tablet eb8a6c4c96814703994d981ed4df4962 (table test-table [id=11367498d43049208e892de5b1111c94]) successfully deleted
I20260806 16:57:07.807768 10144 tablet_bootstrap.cc:492] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: No bootstrap required, opened a new log
I20260806 16:57:07.807859 10144 ts_tablet_manager.cc:1397] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 16:57:07.808297 10144 raft_consensus.cc:348] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.808421 10144 raft_consensus.cc:374] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.808465 10144 raft_consensus.cc:729] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.808594 10144 consensus_queue.cc:260] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.808915 10144 ts_tablet_manager.cc:1428] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:07.808996 10190 ts_tablet_manager.cc:1939] T eb8a6c4c96814703994d981ed4df4962 P 5207ef480dce42788634f8c5d7dc03d2: Deleting consensus metadata
I20260806 16:57:07.811110 10192 ts_tablet_manager.cc:1918] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:07.811160 9588 catalog_manager.cc:4841] TS 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343): tablet eb8a6c4c96814703994d981ed4df4962 (table test-table [id=11367498d43049208e892de5b1111c94]) successfully deleted
I20260806 16:57:07.811288 10192 log.cc:1196] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/eb8a6c4c96814703994d981ed4df4962
I20260806 16:57:07.811645 10192 ts_tablet_manager.cc:1939] T eb8a6c4c96814703994d981ed4df4962 P 75781846d5ef45408056c2d99ee4f235: Deleting consensus metadata
I20260806 16:57:07.812994 9586 catalog_manager.cc:4841] TS 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787): tablet eb8a6c4c96814703994d981ed4df4962 (table test-table [id=11367498d43049208e892de5b1111c94]) successfully deleted
I20260806 16:57:07.813262 10145 tablet_bootstrap.cc:492] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: No bootstrap required, opened a new log
I20260806 16:57:07.813372 10145 ts_tablet_manager.cc:1397] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260806 16:57:07.813493 10143 tablet_bootstrap.cc:492] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: No bootstrap required, opened a new log
I20260806 16:57:07.813606 10143 ts_tablet_manager.cc:1397] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260806 16:57:07.813907 10145 raft_consensus.cc:348] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.814040 10145 raft_consensus.cc:374] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.814082 10145 raft_consensus.cc:729] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5207ef480dce42788634f8c5d7dc03d2, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.814095 10143 raft_consensus.cc:348] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.814236 10143 raft_consensus.cc:374] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:07.814278 10143 raft_consensus.cc:729] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Initialized, Role: FOLLOWER
I20260806 16:57:07.814245 10145 consensus_queue.cc:260] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.814410 10143 consensus_queue.cc:260] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.814513 10145 ts_tablet_manager.cc:1428] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:07.814682 10143 ts_tablet_manager.cc:1428] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:07.974880 10156 raft_consensus.cc:482] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:07.975044 10156 raft_consensus.cc:504] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.975520 10156 leader_election.cc:288] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:07.976042 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b64a72517e40768009d0aa3de2611c" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2" is_pre_election: true
I20260806 16:57:07.976045 9921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b64a72517e40768009d0aa3de2611c" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75781846d5ef45408056c2d99ee4f235" is_pre_election: true
I20260806 16:57:07.976209 10068 raft_consensus.cc:2454] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 0.
I20260806 16:57:07.976233 9921 raft_consensus.cc:2454] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 0.
I20260806 16:57:07.976576 9698 leader_election.cc:302] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 5207ef480dce42788634f8c5d7dc03d2; no voters:
I20260806 16:57:07.976818 10156 raft_consensus.cc:2781] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:07.976876 10156 raft_consensus.cc:482] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:07.976924 10156 raft_consensus.cc:3037] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.977977 10156 raft_consensus.cc:504] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.978399 10156 leader_election.cc:288] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 election: Requested vote from peers 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:07.978809 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b64a72517e40768009d0aa3de2611c" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2"
I20260806 16:57:07.978835 9921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92b64a72517e40768009d0aa3de2611c" candidate_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75781846d5ef45408056c2d99ee4f235"
I20260806 16:57:07.978957 10068 raft_consensus.cc:3037] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.978976 9921 raft_consensus.cc:3037] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:07.979982 10068 raft_consensus.cc:2454] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 1.
I20260806 16:57:07.980257 9921 raft_consensus.cc:2454] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d80cdb1e64141099b1e50695a7ee7ca in term 1.
I20260806 16:57:07.980345 9698 leader_election.cc:302] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 5207ef480dce42788634f8c5d7dc03d2; no voters:
I20260806 16:57:07.980571 10156 raft_consensus.cc:2781] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:07.980667 10156 raft_consensus.cc:686] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 LEADER]: Becoming Leader. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Running, Role: LEADER
I20260806 16:57:07.980841 10156 consensus_queue.cc:237] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:07.983007 9602 catalog_manager.cc:5495] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1). New cstate: current_term: 1 leader_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:08.018476 9920 raft_consensus.cc:1261] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Refusing update from remote peer 3d80cdb1e64141099b1e50695a7ee7ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:08.018643 10068 raft_consensus.cc:1261] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Refusing update from remote peer 3d80cdb1e64141099b1e50695a7ee7ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:08.018997 10156 consensus_queue.cc:1035] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:08.019196 10186 consensus_queue.cc:1035] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 16:57:08.035305 10171 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 16:57:09.594611 9601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:09.594796 9601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:09.597580 9601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Sending DeleteTablet for 3 replicas of tablet 92b64a72517e40768009d0aa3de2611c
I20260806 16:57:09.598299 9749 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b64a72517e40768009d0aa3de2611c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:09 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:50866
I20260806 16:57:09.598456 9901 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b64a72517e40768009d0aa3de2611c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:09 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38382
I20260806 16:57:09.598469 10050 tablet_service.cc:1514] Processing DeleteTablet for tablet 92b64a72517e40768009d0aa3de2611c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:09 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38446
I20260806 16:57:09.598917 10222 tablet_replica.cc:330] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: stopping tablet replica
I20260806 16:57:09.599143 10222 raft_consensus.cc:2229] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:09.599347 10222 raft_consensus.cc:2258] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:09.599628 10220 tablet_replica.cc:330] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: stopping tablet replica
I20260806 16:57:09.599768 10220 raft_consensus.cc:2229] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:09.600004 10220 raft_consensus.cc:2258] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:09.600276 10222 ts_tablet_manager.cc:1905] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:09.600278 10221 tablet_replica.cc:330] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: stopping tablet replica
I20260806 16:57:09.600414 10221 raft_consensus.cc:2229] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:09.600571 10221 raft_consensus.cc:2258] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:09.601156 10220 ts_tablet_manager.cc:1905] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:09.601308 10221 ts_tablet_manager.cc:1905] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:09.603570 10222 ts_tablet_manager.cc:1918] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 16:57:09.603729 10222 log.cc:1196] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/92b64a72517e40768009d0aa3de2611c
I20260806 16:57:09.604085 10222 ts_tablet_manager.cc:1939] T 92b64a72517e40768009d0aa3de2611c P 5207ef480dce42788634f8c5d7dc03d2: Deleting consensus metadata
I20260806 16:57:09.604358 10221 ts_tablet_manager.cc:1918] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 16:57:09.604444 10221 log.cc:1196] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/92b64a72517e40768009d0aa3de2611c
I20260806 16:57:09.604470 10220 ts_tablet_manager.cc:1918] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 16:57:09.604593 10220 log.cc:1196] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/92b64a72517e40768009d0aa3de2611c
I20260806 16:57:09.604746 10221 ts_tablet_manager.cc:1939] T 92b64a72517e40768009d0aa3de2611c P 75781846d5ef45408056c2d99ee4f235: Deleting consensus metadata
I20260806 16:57:09.604992 10220 ts_tablet_manager.cc:1939] T 92b64a72517e40768009d0aa3de2611c P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting consensus metadata
I20260806 16:57:09.605012 9588 catalog_manager.cc:4841] TS 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343): tablet 92b64a72517e40768009d0aa3de2611c (table test-table [id=888f5a4a6b1e4920aa330efe451ab271]) successfully deleted
I20260806 16:57:09.605556 9586 catalog_manager.cc:4841] TS 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787): tablet 92b64a72517e40768009d0aa3de2611c (table test-table [id=888f5a4a6b1e4920aa330efe451ab271]) successfully deleted
I20260806 16:57:09.605731 9586 catalog_manager.cc:4841] TS 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773): tablet 92b64a72517e40768009d0aa3de2611c (table test-table [id=888f5a4a6b1e4920aa330efe451ab271]) successfully deleted
Aug 06 16:57:09 dist-test-slave-cbsf krb5kdc[9554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035429, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 16:57:09 dist-test-slave-cbsf krb5kdc[9554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035429, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:09.633340 10230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.622020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59068 (local address 127.7.153.62:42151)
0806 16:57:09.622424 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:09.622433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:09.622450 (+ 17us) server_negotiation.cc:407] Connection header received
0806 16:57:09.622518 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:09.622521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:09.622600 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:09.622714 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:09.623478 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.624534 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.626002 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.626252 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.626344 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.629272 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:09.629276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:09.629278 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:09.629308 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:09.631134 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:09.631644 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:09.631647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:09.631648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:09.631740 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:09.632065 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:09.632068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:09.632070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:09.632301 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:09.632427 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:09.632986 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 16:57:09.633174 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":153,"threads_started":1}
I20260806 16:57:09.636602 9601 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59068:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:09.637202 9601 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:09.643082 9901 tablet_service.cc:1467] Processing CreateTablet for tablet 2372f5b9645b4939ba8a37765b3d80c5 (DEFAULT_TABLE table=test-table [id=ac855033cbd14986ba00659ad9d22e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:09.643082 9749 tablet_service.cc:1467] Processing CreateTablet for tablet 2372f5b9645b4939ba8a37765b3d80c5 (DEFAULT_TABLE table=test-table [id=ac855033cbd14986ba00659ad9d22e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:09.643340 10050 tablet_service.cc:1467] Processing CreateTablet for tablet 2372f5b9645b4939ba8a37765b3d80c5 (DEFAULT_TABLE table=test-table [id=ac855033cbd14986ba00659ad9d22e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:09.643427 9901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2372f5b9645b4939ba8a37765b3d80c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:09.643427 9749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2372f5b9645b4939ba8a37765b3d80c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:09.643584 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2372f5b9645b4939ba8a37765b3d80c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:09.646123 10231 tablet_bootstrap.cc:492] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Bootstrap starting.
I20260806 16:57:09.646359 10232 tablet_bootstrap.cc:492] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Bootstrap starting.
I20260806 16:57:09.646593 10234 tablet_bootstrap.cc:492] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Bootstrap starting.
I20260806 16:57:09.647514 10231 tablet_bootstrap.cc:654] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:09.647631 10234 tablet_bootstrap.cc:654] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:09.647682 10232 tablet_bootstrap.cc:654] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:09.648909 10234 tablet_bootstrap.cc:492] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: No bootstrap required, opened a new log
I20260806 16:57:09.648911 10231 tablet_bootstrap.cc:492] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: No bootstrap required, opened a new log
I20260806 16:57:09.649009 10234 ts_tablet_manager.cc:1397] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 16:57:09.649034 10231 ts_tablet_manager.cc:1397] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:09.649597 10232 tablet_bootstrap.cc:492] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: No bootstrap required, opened a new log
I20260806 16:57:09.649525 10231 raft_consensus.cc:348] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.649521 10234 raft_consensus.cc:348] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.649648 10231 raft_consensus.cc:374] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:09.649667 10234 raft_consensus.cc:374] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:09.649693 10231 raft_consensus.cc:729] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5207ef480dce42788634f8c5d7dc03d2, State: Initialized, Role: FOLLOWER
I20260806 16:57:09.649703 10234 raft_consensus.cc:729] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Initialized, Role: FOLLOWER
I20260806 16:57:09.649736 10232 ts_tablet_manager.cc:1397] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:09.649822 10231 consensus_queue.cc:260] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.649834 10234 consensus_queue.cc:260] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.650115 10234 ts_tablet_manager.cc:1428] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:09.650235 10231 ts_tablet_manager.cc:1428] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:09.650236 10232 raft_consensus.cc:348] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.650377 10232 raft_consensus.cc:374] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:09.650408 10232 raft_consensus.cc:729] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Initialized, Role: FOLLOWER
I20260806 16:57:09.650529 10232 consensus_queue.cc:260] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.650992 10232 ts_tablet_manager.cc:1428] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:09.680325 10239 raft_consensus.cc:482] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:09.680485 10239 raft_consensus.cc:504] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.681730 10239 leader_election.cc:288] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:09.687896 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.682124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:46559 (local address 127.7.153.3:33343)
0806 16:57:09.682463 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:09.682473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:09.682602 (+ 129us) server_negotiation.cc:407] Connection header received
0806 16:57:09.682769 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:09.682772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:09.682825 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:09.682933 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:09.683339 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.684183 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.686178 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.686866 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.686983 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.687087 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:09.687631 (+ 544us) server_negotiation.cc:299] Negotiation successful
0806 16:57:09.687721 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":113,"threads_started":1}
I20260806 16:57:09.687922 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.682017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:33343 (local address 127.7.153.2:46559)
0806 16:57:09.682473 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:09.682490 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:09.682651 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:09.682955 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:09.682958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:09.682994 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:09.683217 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.683224 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.684334 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.684340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.685994 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.686010 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.687141 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.687152 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.687438 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.687487 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 16:57:09.687595 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 16:57:09.687701 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":261,"spinlock_wait_cycles":27008,"thread_start_us":147,"threads_started":1}
I20260806 16:57:09.688162 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.682017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44773 (local address 127.7.153.2:49077)
0806 16:57:09.682513 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:09.682528 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:09.682651 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:09.682955 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:09.682958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:09.682994 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:09.683217 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.683224 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.684347 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.684349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.685994 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.686010 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.687158 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.687161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.687444 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.687484 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 16:57:09.687882 (+ 398us) client_negotiation.cc:240] Negotiation successful
0806 16:57:09.687990 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":297,"spinlock_wait_cycles":42624,"thread_start_us":85,"threads_started":1}
I20260806 16:57:09.688632 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.682276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:49077 (local address 127.7.153.1:44773)
0806 16:57:09.682573 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:09.682582 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:09.682597 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:09.682769 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:09.682772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:09.682825 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:09.682933 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:09.683339 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.684184 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.686178 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.686853 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.686983 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.687077 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:09.688374 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0806 16:57:09.688482 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":111,"threads_started":1}
I20260806 16:57:09.688817 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2372f5b9645b4939ba8a37765b3d80c5" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2" is_pre_election: true
I20260806 16:57:09.689015 10068 raft_consensus.cc:2454] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 0.
I20260806 16:57:09.689169 9772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2372f5b9645b4939ba8a37765b3d80c5" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" is_pre_election: true
I20260806 16:57:09.689440 9772 raft_consensus.cc:2454] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 0.
I20260806 16:57:09.689476 9850 leader_election.cc:302] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5207ef480dce42788634f8c5d7dc03d2, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:09.689801 10239 raft_consensus.cc:2781] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:09.689885 10239 raft_consensus.cc:482] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:09.689944 10239 raft_consensus.cc:3037] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:09.691038 10239 raft_consensus.cc:504] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.691448 10239 leader_election.cc:288] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 election: Requested vote from peers 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:09.691887 9772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2372f5b9645b4939ba8a37765b3d80c5" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d80cdb1e64141099b1e50695a7ee7ca"
I20260806 16:57:09.691870 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2372f5b9645b4939ba8a37765b3d80c5" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2"
I20260806 16:57:09.692035 9772 raft_consensus.cc:3037] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:09.692041 10068 raft_consensus.cc:3037] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:09.693089 9772 raft_consensus.cc:2454] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 1.
I20260806 16:57:09.693089 10068 raft_consensus.cc:2454] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 1.
I20260806 16:57:09.693491 9848 leader_election.cc:302] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 5207ef480dce42788634f8c5d7dc03d2, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:09.693712 10239 raft_consensus.cc:2781] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:09.693922 10239 raft_consensus.cc:686] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 1 LEADER]: Becoming Leader. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Running, Role: LEADER
I20260806 16:57:09.694195 10239 consensus_queue.cc:237] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.696990 9601 catalog_manager.cc:5495] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75781846d5ef45408056c2d99ee4f235 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "75781846d5ef45408056c2d99ee4f235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:09.715214 10248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.710283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38398 (local address 127.7.153.2:34787)
0806 16:57:09.710569 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:09.710576 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:09.710589 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:09.710689 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:09.710691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:09.710749 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:09.710866 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:09.711118 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.711675 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.712641 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.713117 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.713373 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.713874 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:09.714585 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:09.714706 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:09.714918 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 16:57:09.715009 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":133,"threads_started":1}
I20260806 16:57:09.730193 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.725910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:37777 (local address 127.7.153.1:44773)
0806 16:57:09.726114 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:09.726119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:09.726351 (+ 232us) server_negotiation.cc:407] Connection header received
0806 16:57:09.726561 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:09.726564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:09.726646 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:09.726732 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:09.727121 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.727801 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.729043 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.729284 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.729375 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.729739 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:09.729836 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:09.729895 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:09.730002 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 16:57:09.730071 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 16:57:09.730219 10251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.725736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44773 (local address 127.7.153.2:37777)
0806 16:57:09.726225 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:09.726241 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:09.726426 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:09.726755 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:09.726759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:09.726767 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:09.726931 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.726937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.728013 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.728017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.728896 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.728910 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.729399 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.729401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.729479 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.729547 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:09.729916 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:09.729922 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 16:57:09.729977 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 16:57:09.730066 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":154,"threads_started":1}
I20260806 16:57:09.738037 10068 raft_consensus.cc:1261] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Refusing update from remote peer 75781846d5ef45408056c2d99ee4f235: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:09.738189 9772 raft_consensus.cc:1261] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Refusing update from remote peer 75781846d5ef45408056c2d99ee4f235: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:09.738832 10239 consensus_queue.cc:1035] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:09.739337 10245 consensus_queue.cc:1035] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:09.759413 10257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.755001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34787 (local address 127.7.153.1:41555)
0806 16:57:09.755546 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:09.755564 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:09.755780 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:09.756175 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:09.756216 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:09.756228 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:09.756344 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.756350 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.757113 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.757119 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.758010 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:09.758020 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.758600 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.758604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:09.758728 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.758770 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:09.759074 (+ 304us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:09.759082 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 16:57:09.759165 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 16:57:09.759254 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":125,"threads_started":1}
I20260806 16:57:09.759783 10248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:09.755137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:41555 (local address 127.7.153.2:34787)
0806 16:57:09.755338 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:09.755342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:09.755727 (+ 385us) server_negotiation.cc:407] Connection header received
0806 16:57:09.755968 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:09.755974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:09.756064 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:09.756142 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:09.756444 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.757013 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.758159 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:09.758461 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:09.758587 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:09.758900 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:09.758987 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:09.759064 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:09.759613 (+ 549us) server_negotiation.cc:299] Negotiation successful
0806 16:57:09.759678 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 16:57:09.785727 9600 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:09.785890 9600 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:09.788247 9600 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Sending DeleteTablet for 3 replicas of tablet 2372f5b9645b4939ba8a37765b3d80c5
I20260806 16:57:09.789052 10050 tablet_service.cc:1514] Processing DeleteTablet for tablet 2372f5b9645b4939ba8a37765b3d80c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:09 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38446
I20260806 16:57:09.789050 9749 tablet_service.cc:1514] Processing DeleteTablet for tablet 2372f5b9645b4939ba8a37765b3d80c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:09 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:50866
I20260806 16:57:09.789062 9901 tablet_service.cc:1514] Processing DeleteTablet for tablet 2372f5b9645b4939ba8a37765b3d80c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:09 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38382
I20260806 16:57:09.789268 10221 tablet_replica.cc:330] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: stopping tablet replica
I20260806 16:57:09.789268 10222 tablet_replica.cc:330] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: stopping tablet replica
I20260806 16:57:09.789296 10220 tablet_replica.cc:330] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: stopping tablet replica
I20260806 16:57:09.789383 10222 raft_consensus.cc:2229] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:09.789392 10221 raft_consensus.cc:2229] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:09.789410 10220 raft_consensus.cc:2229] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:09.789510 10222 raft_consensus.cc:2258] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:09.789541 10220 raft_consensus.cc:2258] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:09.789778 10221 raft_consensus.cc:2258] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:09.790373 10220 ts_tablet_manager.cc:1905] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:09.790475 10222 ts_tablet_manager.cc:1905] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:09.790499 10221 ts_tablet_manager.cc:1905] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:09.793186 10221 ts_tablet_manager.cc:1918] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:09.793186 10222 ts_tablet_manager.cc:1918] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:09.793268 10221 log.cc:1196] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/2372f5b9645b4939ba8a37765b3d80c5
I20260806 16:57:09.793268 10222 log.cc:1196] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/2372f5b9645b4939ba8a37765b3d80c5
I20260806 16:57:09.793315 10220 ts_tablet_manager.cc:1918] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:09.793394 10220 log.cc:1196] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/2372f5b9645b4939ba8a37765b3d80c5
I20260806 16:57:09.793541 10221 ts_tablet_manager.cc:1939] T 2372f5b9645b4939ba8a37765b3d80c5 P 75781846d5ef45408056c2d99ee4f235: Deleting consensus metadata
I20260806 16:57:09.793541 10222 ts_tablet_manager.cc:1939] T 2372f5b9645b4939ba8a37765b3d80c5 P 5207ef480dce42788634f8c5d7dc03d2: Deleting consensus metadata
I20260806 16:57:09.793676 10220 ts_tablet_manager.cc:1939] T 2372f5b9645b4939ba8a37765b3d80c5 P 3d80cdb1e64141099b1e50695a7ee7ca: Deleting consensus metadata
I20260806 16:57:09.794344 9586 catalog_manager.cc:4841] TS 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787): tablet 2372f5b9645b4939ba8a37765b3d80c5 (table test-table [id=ac855033cbd14986ba00659ad9d22e38]) successfully deleted
I20260806 16:57:09.794564 9586 catalog_manager.cc:4841] TS 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773): tablet 2372f5b9645b4939ba8a37765b3d80c5 (table test-table [id=ac855033cbd14986ba00659ad9d22e38]) successfully deleted
I20260806 16:57:09.794344 9588 catalog_manager.cc:4841] TS 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343): tablet 2372f5b9645b4939ba8a37765b3d80c5 (table test-table [id=ac855033cbd14986ba00659ad9d22e38]) successfully deleted
I20260806 16:57:09.795913 9600 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59068:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:09.796444 9600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:09.801877 9901 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0df33de79041e1adefa3cf898adbcb (DEFAULT_TABLE table=test-table [id=a345dff5f8c94850b613f13598fd78e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:09.801843 9749 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0df33de79041e1adefa3cf898adbcb (DEFAULT_TABLE table=test-table [id=a345dff5f8c94850b613f13598fd78e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:09.802000 10050 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0df33de79041e1adefa3cf898adbcb (DEFAULT_TABLE table=test-table [id=a345dff5f8c94850b613f13598fd78e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:09.802218 9749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0df33de79041e1adefa3cf898adbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:09.802217 9901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0df33de79041e1adefa3cf898adbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:09.802291 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0df33de79041e1adefa3cf898adbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:09.804752 10231 tablet_bootstrap.cc:492] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Bootstrap starting.
I20260806 16:57:09.804824 10232 tablet_bootstrap.cc:492] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Bootstrap starting.
I20260806 16:57:09.805817 10231 tablet_bootstrap.cc:654] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:09.805893 10232 tablet_bootstrap.cc:654] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:09.806751 10234 tablet_bootstrap.cc:492] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca: Bootstrap starting.
I20260806 16:57:09.807577 10234 tablet_bootstrap.cc:654] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:09.807762 10231 tablet_bootstrap.cc:492] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: No bootstrap required, opened a new log
I20260806 16:57:09.807857 10231 ts_tablet_manager.cc:1397] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:09.808354 10231 raft_consensus.cc:348] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.808503 10231 raft_consensus.cc:374] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:09.808542 10231 raft_consensus.cc:729] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5207ef480dce42788634f8c5d7dc03d2, State: Initialized, Role: FOLLOWER
I20260806 16:57:09.808743 10234 tablet_bootstrap.cc:492] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca: No bootstrap required, opened a new log
I20260806 16:57:09.808732 10231 consensus_queue.cc:260] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.808825 10234 ts_tablet_manager.cc:1397] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 16:57:09.809062 10231 ts_tablet_manager.cc:1428] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 16:57:09.809202 10234 raft_consensus.cc:348] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.809303 10234 raft_consensus.cc:374] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:09.809333 10234 raft_consensus.cc:729] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d80cdb1e64141099b1e50695a7ee7ca, State: Initialized, Role: FOLLOWER
I20260806 16:57:09.809484 10232 tablet_bootstrap.cc:492] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: No bootstrap required, opened a new log
I20260806 16:57:09.809455 10234 consensus_queue.cc:260] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.809568 10232 ts_tablet_manager.cc:1397] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 16:57:09.809721 10234 ts_tablet_manager.cc:1428] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:09.810045 10232 raft_consensus.cc:348] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.810166 10232 raft_consensus.cc:374] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:09.810209 10232 raft_consensus.cc:729] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Initialized, Role: FOLLOWER
I20260806 16:57:09.810375 10232 consensus_queue.cc:260] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.812081 10232 ts_tablet_manager.cc:1428] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 16:57:09.883641 10255 raft_consensus.cc:482] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:09.883793 10255 raft_consensus.cc:504] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.884297 10255 leader_election.cc:288] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:09.884860 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0df33de79041e1adefa3cf898adbcb" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2" is_pre_election: true
I20260806 16:57:09.884873 9772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0df33de79041e1adefa3cf898adbcb" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" is_pre_election: true
I20260806 16:57:09.885041 10068 raft_consensus.cc:2454] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 0.
I20260806 16:57:09.885056 9772 raft_consensus.cc:2454] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 0.
I20260806 16:57:09.885388 9850 leader_election.cc:302] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5207ef480dce42788634f8c5d7dc03d2, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:09.885608 10255 raft_consensus.cc:2781] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:09.885681 10255 raft_consensus.cc:482] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:09.885738 10255 raft_consensus.cc:3037] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:09.886766 10255 raft_consensus.cc:504] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.887163 10255 leader_election.cc:288] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 election: Requested vote from peers 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773), 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343)
I20260806 16:57:09.887568 9772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0df33de79041e1adefa3cf898adbcb" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d80cdb1e64141099b1e50695a7ee7ca"
I20260806 16:57:09.887729 9772 raft_consensus.cc:3037] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:09.888808 9772 raft_consensus.cc:2454] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 1.
I20260806 16:57:09.888878 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0df33de79041e1adefa3cf898adbcb" candidate_uuid: "75781846d5ef45408056c2d99ee4f235" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5207ef480dce42788634f8c5d7dc03d2"
I20260806 16:57:09.889024 10068 raft_consensus.cc:3037] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:09.889187 9848 leader_election.cc:302] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d80cdb1e64141099b1e50695a7ee7ca, 75781846d5ef45408056c2d99ee4f235; no voters:
I20260806 16:57:09.889401 10255 raft_consensus.cc:2781] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:09.889500 10255 raft_consensus.cc:686] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 1 LEADER]: Becoming Leader. State: Replica: 75781846d5ef45408056c2d99ee4f235, State: Running, Role: LEADER
I20260806 16:57:09.889643 10255 consensus_queue.cc:237] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } }
I20260806 16:57:09.890460 10068 raft_consensus.cc:2454] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75781846d5ef45408056c2d99ee4f235 in term 1.
I20260806 16:57:09.891721 9602 catalog_manager.cc:5495] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75781846d5ef45408056c2d99ee4f235 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "75781846d5ef45408056c2d99ee4f235" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75781846d5ef45408056c2d99ee4f235" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:09.927503 10068 raft_consensus.cc:1261] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Refusing update from remote peer 75781846d5ef45408056c2d99ee4f235: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:09.927521 9772 raft_consensus.cc:1261] T 7f0df33de79041e1adefa3cf898adbcb P 3d80cdb1e64141099b1e50695a7ee7ca [term 1 FOLLOWER]: Refusing update from remote peer 75781846d5ef45408056c2d99ee4f235: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:09.927935 10255 consensus_queue.cc:1035] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d80cdb1e64141099b1e50695a7ee7ca" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:09.928082 10239 consensus_queue.cc:1035] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5207ef480dce42788634f8c5d7dc03d2" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 33343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 16:57:09.944902 10204 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 16:57:11.503038 9602 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:11.503211 9602 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:11.505885 9602 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 856b2ffa6e0e406a9b7975c85c87ec14: Sending DeleteTablet for 3 replicas of tablet 7f0df33de79041e1adefa3cf898adbcb
I20260806 16:57:11.506683 9901 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0df33de79041e1adefa3cf898adbcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:11 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38382
I20260806 16:57:11.506690 10050 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0df33de79041e1adefa3cf898adbcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:11 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38446
I20260806 16:57:11.506975 9749 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0df33de79041e1adefa3cf898adbcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:11 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:50866
I20260806 16:57:11.507085 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9677
I20260806 16:57:11.507128 10288 tablet_replica.cc:330] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: stopping tablet replica
I20260806 16:57:11.508478 10288 raft_consensus.cc:2229] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:11.508795 10288 raft_consensus.cc:2258] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:11.509115 10289 tablet_replica.cc:330] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: stopping tablet replica
I20260806 16:57:11.509307 10289 raft_consensus.cc:2229] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:11.509461 10289 raft_consensus.cc:2258] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:11.510339 10289 ts_tablet_manager.cc:1905] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:11.510996 10288 ts_tablet_manager.cc:1905] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:11.513419 10289 ts_tablet_manager.cc:1918] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 16:57:11.513538 10289 log.cc:1196] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/7f0df33de79041e1adefa3cf898adbcb
I20260806 16:57:11.513863 10289 ts_tablet_manager.cc:1939] T 7f0df33de79041e1adefa3cf898adbcb P 5207ef480dce42788634f8c5d7dc03d2: Deleting consensus metadata
I20260806 16:57:11.513888 10288 ts_tablet_manager.cc:1918] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 16:57:11.513958 10288 log.cc:1196] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/7f0df33de79041e1adefa3cf898adbcb
I20260806 16:57:11.514303 10288 ts_tablet_manager.cc:1939] T 7f0df33de79041e1adefa3cf898adbcb P 75781846d5ef45408056c2d99ee4f235: Deleting consensus metadata
I20260806 16:57:11.514853 9588 catalog_manager.cc:4841] TS 5207ef480dce42788634f8c5d7dc03d2 (127.7.153.3:33343): tablet 7f0df33de79041e1adefa3cf898adbcb (table test-table [id=a345dff5f8c94850b613f13598fd78e5]) successfully deleted
I20260806 16:57:11.515116 9586 catalog_manager.cc:4841] TS 75781846d5ef45408056c2d99ee4f235 (127.7.153.2:34787): tablet 7f0df33de79041e1adefa3cf898adbcb (table test-table [id=a345dff5f8c94850b613f13598fd78e5]) successfully deleted
W20260806 16:57:11.518603 9586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:44773 (error 108)
I20260806 16:57:11.518772 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9828
I20260806 16:57:11.522125 10292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:11.521639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44773 (local address 127.0.0.1:59134)
0806 16:57:11.521941 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:11.522024 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:44773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":103,"threads_started":1}
W20260806 16:57:11.522294 9586 catalog_manager.cc:4584] TS 3d80cdb1e64141099b1e50695a7ee7ca (127.7.153.1:44773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f0df33de79041e1adefa3cf898adbcb: Network error: Client connection negotiation failed: client connection to 127.7.153.1:44773: connect: Connection refused (error 111)
I20260806 16:57:11.529114 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9980
I20260806 16:57:11.537560 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 9569
2026-08-06T16:57:11Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6689 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:11 dist-test-slave-cbsf krb5kdc[10296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:11 dist-test-slave-cbsf krb5kdc[10296](info): set up 2 sockets
Aug 06 16:57:11 dist-test-slave-cbsf krb5kdc[10296](info): commencing operation
krb5kdc: starting...
W20260806 16:57:12.657210 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:12 dist-test-slave-cbsf krb5kdc[10296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:12.792573 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37399
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:37399
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:12.915659 10309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:12.916046 10309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:12.916134 10309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:12.920532 10309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:12.920643 10309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:12.920682 10309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:12.920749 10309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:12.920801 10309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:12.926730 10309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:37399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:12.928050 10309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:12.929265 10309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:12.939168 10315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:12.939352 10314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:12.939349 10309 server_base.cc:1034] running on GCE node
W20260806 16:57:12.939402 10317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:12.940279 10309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:12.941606 10309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:12.942821 10309 hybrid_clock.cc:648] HybridClock initialized: now 1786035432942782 us; error 54 us; skew 500 ppm
Aug 06 16:57:12 dist-test-slave-cbsf krb5kdc[10296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035432, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:12.946043 10309 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:12.947105 10309 webserver.cc:460] Webserver started at http://127.7.153.62:39881/ using document root <none> and password file <none>
I20260806 16:57:12.947762 10309 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:12.947863 10309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:12.948113 10309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:12.950507 10309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "f73e7f17f77d4a7b936b999dc973f9b1"
format_stamp: "Formatted at 2026-08-06 16:57:12 on dist-test-slave-cbsf"
server_key: "3fbafe3d0bd48f42cb416dd108ae0266"
server_key_iv: "7db1adae5e16006a2d6a928f6c96749d"
server_key_version: "encryptionkey@0"
I20260806 16:57:12.951200 10309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "f73e7f17f77d4a7b936b999dc973f9b1"
format_stamp: "Formatted at 2026-08-06 16:57:12 on dist-test-slave-cbsf"
server_key: "3fbafe3d0bd48f42cb416dd108ae0266"
server_key_iv: "7db1adae5e16006a2d6a928f6c96749d"
server_key_version: "encryptionkey@0"
I20260806 16:57:12.955866 10309 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:12.959056 10325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:12.960842 10309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 16:57:12.961041 10309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "f73e7f17f77d4a7b936b999dc973f9b1"
format_stamp: "Formatted at 2026-08-06 16:57:12 on dist-test-slave-cbsf"
server_key: "3fbafe3d0bd48f42cb416dd108ae0266"
server_key_iv: "7db1adae5e16006a2d6a928f6c96749d"
server_key_version: "encryptionkey@0"
I20260806 16:57:12.961198 10309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:12.978067 10309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:12.982016 10309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:12.982277 10309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:12.991551 10309 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:37399
I20260806 16:57:12.991645 10380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:37399 every 8 connection(s)
I20260806 16:57:12.993836 10309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:12.998356 10381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:13.002197 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 10309
I20260806 16:57:13.002351 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:13.002643 7780 external_mini_cluster.cc:1428] Setting key 1590d41721fea568e16b47fb2284284c
I20260806 16:57:13.006297 10381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1: Bootstrap starting.
I20260806 16:57:13.009374 10381 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:13.010308 10381 log.cc:824] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:13.013903 10381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1: No bootstrap required, opened a new log
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:13.018352 10381 raft_consensus.cc:348] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37399 } }
I20260806 16:57:13.018771 10381 raft_consensus.cc:374] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:13.018869 10381 raft_consensus.cc:729] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f73e7f17f77d4a7b936b999dc973f9b1, State: Initialized, Role: FOLLOWER
I20260806 16:57:13.019459 10381 consensus_queue.cc:260] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37399 } }
I20260806 16:57:13.019635 10381 raft_consensus.cc:388] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:13.019714 10381 raft_consensus.cc:482] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:13.019832 10381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:13.021064 10381 raft_consensus.cc:504] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37399 } }
I20260806 16:57:13.021477 10381 leader_election.cc:302] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f73e7f17f77d4a7b936b999dc973f9b1; no voters:
I20260806 16:57:13.021930 10381 leader_election.cc:288] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:13.022092 10386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:13.022360 10386 raft_consensus.cc:686] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [term 1 LEADER]: Becoming Leader. State: Replica: f73e7f17f77d4a7b936b999dc973f9b1, State: Running, Role: LEADER
I20260806 16:57:13.022712 10386 consensus_queue.cc:237] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37399 } }
I20260806 16:57:13.023240 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.004436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45280 (local address 127.7.153.62:37399)
0806 16:57:13.005082 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:13.005102 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:13.005463 (+ 361us) server_negotiation.cc:407] Connection header received
0806 16:57:13.006667 (+ 1204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:13.006697 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:13.007256 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:13.007694 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:13.008897 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.010125 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.011308 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.012035 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.012203 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.016270 (+ 4067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:13.016278 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:13.016303 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:13.016348 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:13.019524 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.020237 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.020243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.020249 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.020386 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.020728 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.020733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.020735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.021241 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:13.021477 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:13.021778 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 16:57:13.022153 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":212,"threads_started":1}
I20260806 16:57:13.023499 10381 sys_catalog.cc:564] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:13.024128 10386 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f73e7f17f77d4a7b936b999dc973f9b1. Latest consensus state: current_term: 1 leader_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37399 } } }
I20260806 16:57:13.024267 10386 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:13.024739 10387 sys_catalog.cc:455] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f73e7f17f77d4a7b936b999dc973f9b1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37399 } } }
I20260806 16:57:13.024849 10387 sys_catalog.cc:458] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1 [sys.catalog]: This master's current role is: LEADER
W20260806 16:57:13.028956 10403 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:13.029085 10403 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:13.029168 10392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:13.030228 10392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:13.039214 10392 catalog_manager.cc:1347] Generated new cluster ID: f02213f3ddb14695913f7544f09d8dd8
I20260806 16:57:13.039321 10392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:13.047041 10392 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:13.048542 10392 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:13.058352 10392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f73e7f17f77d4a7b936b999dc973f9b1: Generated new TSK 0
I20260806 16:57:13.059187 10392 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:13.103652 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37399
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:13.245606 10411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:13.246078 10411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:13.246133 10411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:13.251405 10411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:13.251521 10411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:13.251597 10411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:13.259291 10411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:13.260613 10411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:13.261754 10411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:13.272735 10416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:13.272886 10411 server_base.cc:1034] running on GCE node
W20260806 16:57:13.272735 10421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:13.272735 10417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:13.273562 10411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:13.274397 10411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:13.275619 10411 hybrid_clock.cc:648] HybridClock initialized: now 1786035433275598 us; error 39 us; skew 500 ppm
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:13.278882 10411 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:13.279906 10411 webserver.cc:460] Webserver started at http://127.7.153.1:36807/ using document root <none> and password file <none>
I20260806 16:57:13.280529 10411 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:13.280632 10411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:13.280921 10411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:13.283206 10411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "967a70f215484ef386b92022c3fe68f3"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "f02964df7e731d11964dd0e1b4157d02"
server_key_iv: "a2f428063dfd043d525e03b6005c840b"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.283824 10411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "967a70f215484ef386b92022c3fe68f3"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "f02964df7e731d11964dd0e1b4157d02"
server_key_iv: "a2f428063dfd043d525e03b6005c840b"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.288002 10411 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:13.290812 10429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.292183 10411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 16:57:13.292330 10411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "967a70f215484ef386b92022c3fe68f3"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "f02964df7e731d11964dd0e1b4157d02"
server_key_iv: "a2f428063dfd043d525e03b6005c840b"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.292457 10411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:13.316035 10411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:13.319293 10411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:13.319525 10411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:13.320184 10411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:13.321178 10411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:13.321249 10411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.321321 10411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:13.321367 10411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.331288 10411 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:40543
I20260806 16:57:13.331311 10553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:40543 every 8 connection(s)
I20260806 16:57:13.332304 10411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:13.334483 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 10411
I20260806 16:57:13.334611 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:13.334957 7780 external_mini_cluster.cc:1428] Setting key da034ef55459373bbc67facb9e3f5728
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:57:13.347586 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.334282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:50831 (local address 127.7.153.62:37399)
0806 16:57:13.334423 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:13.334426 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:13.335573 (+ 1147us) server_negotiation.cc:407] Connection header received
0806 16:57:13.337059 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:13.337062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:13.337116 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:13.337201 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:13.338438 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.338994 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.340177 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.340419 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.340549 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.343232 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:13.343236 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:13.343239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:13.343274 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:13.345027 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.345719 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.345724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.345726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.345824 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.346247 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.346251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.346253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.346483 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:13.346604 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:13.347207 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 16:57:13.347366 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:13.348515 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.334822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:37399 (local address 127.7.153.1:50831)
0806 16:57:13.335377 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:13.335439 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:13.336842 (+ 1403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:13.337377 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:13.337384 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:13.337756 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:13.338291 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:13.338305 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.339131 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.339134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:13.340047 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:13.340058 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.340603 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.340608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:13.340849 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.341499 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:13.341518 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:13.343043 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:13.345189 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:13.345197 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:13.345224 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:13.345602 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:13.345952 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:13.345955 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:13.345957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:13.346130 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:13.346603 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:13.346613 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:13.346926 (+ 313us) client_negotiation.cc:769] Sending connection context
0806 16:57:13.347147 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 16:57:13.347527 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":168,"threads_started":1}
I20260806 16:57:13.349938 10554 heartbeater.cc:347] Connected to a master server at 127.7.153.62:37399
I20260806 16:57:13.350229 10554 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:13.350808 10554 heartbeater.cc:511] Master 127.7.153.62:37399 requested a full tablet report, sending...
I20260806 16:57:13.352432 10343 ts_manager.cc:194] Registered new tserver with Master: 967a70f215484ef386b92022c3fe68f3 (127.7.153.1:40543)
I20260806 16:57:13.353704 10343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:50831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:13.363791 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37399
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:13.487141 10559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:13.487455 10559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:13.487509 10559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:13.491832 10559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:13.491906 10559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:13.491969 10559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:13.497727 10559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:13.498863 10559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:13.499871 10559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:13.510035 10568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:13.510000 10566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:13.510244 10559 server_base.cc:1034] running on GCE node
W20260806 16:57:13.510007 10565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:13.510798 10559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:13.511567 10559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:13.512771 10559 hybrid_clock.cc:648] HybridClock initialized: now 1786035433512752 us; error 33 us; skew 500 ppm
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:13.515935 10559 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:13.517024 10559 webserver.cc:460] Webserver started at http://127.7.153.2:40043/ using document root <none> and password file <none>
I20260806 16:57:13.517658 10559 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:13.517755 10559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:13.518002 10559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:13.520260 10559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "20684741726848df87d263714f621686"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "f89c0c2c690dedf73a4d77229a152c45"
server_key_iv: "22579d532477e4654980c5c32b0e72ed"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.520929 10559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "20684741726848df87d263714f621686"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "f89c0c2c690dedf73a4d77229a152c45"
server_key_iv: "22579d532477e4654980c5c32b0e72ed"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.525583 10559 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 16:57:13.528308 10575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.529712 10559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 16:57:13.529851 10559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "20684741726848df87d263714f621686"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "f89c0c2c690dedf73a4d77229a152c45"
server_key_iv: "22579d532477e4654980c5c32b0e72ed"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.529981 10559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:13.546029 10559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:13.549692 10559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:13.549924 10559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:13.550587 10559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:13.551501 10559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:13.551553 10559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.551595 10559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:13.551649 10559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.561756 10559 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:37183
I20260806 16:57:13.561774 10695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:37183 every 8 connection(s)
I20260806 16:57:13.562757 10559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:13.572544 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 10559
I20260806 16:57:13.572679 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:13.573160 7780 external_mini_cluster.cc:1428] Setting key d2b626064327c7dd10675d08b03f066f
I20260806 16:57:13.577813 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.564776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:48907 (local address 127.7.153.62:37399)
0806 16:57:13.564911 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:13.564915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:13.566060 (+ 1145us) server_negotiation.cc:407] Connection header received
0806 16:57:13.567068 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:13.567072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:13.567140 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:13.567243 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:13.568495 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.569110 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.570332 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.570565 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.570679 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.573693 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:13.573696 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:13.573699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:13.573744 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:13.575348 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.575916 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.575920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.575922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.576013 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.576376 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.576380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.576382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.576679 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:13.576821 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:13.577423 (+ 602us) server_negotiation.cc:299] Negotiation successful
0806 16:57:13.577585 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 16:57:13.578768 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.565171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:37399 (local address 127.7.153.2:48907)
0806 16:57:13.565883 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:13.565950 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:13.566855 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:13.567441 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:13.567449 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:13.567841 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:13.568346 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:13.568360 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.569239 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.569243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:13.570196 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:13.570211 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.570739 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.570743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:13.570923 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.571583 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:13.571608 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:13.573488 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:13.575481 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:13.575488 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:13.575510 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:13.575808 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:13.576105 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:13.576111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:13.576114 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:13.576277 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:13.576826 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:13.576832 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:13.577118 (+ 286us) client_negotiation.cc:769] Sending connection context
0806 16:57:13.577346 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 16:57:13.577667 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":158,"threads_started":1}
I20260806 16:57:13.580264 10696 heartbeater.cc:347] Connected to a master server at 127.7.153.62:37399
I20260806 16:57:13.580555 10696 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:13.581156 10696 heartbeater.cc:511] Master 127.7.153.62:37399 requested a full tablet report, sending...
I20260806 16:57:13.582381 10343 ts_manager.cc:194] Registered new tserver with Master: 20684741726848df87d263714f621686 (127.7.153.2:37183)
I20260806 16:57:13.582995 10343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:48907
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:13.603657 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37399
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:13.726768 10701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:13.727149 10701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:13.727239 10701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:13.732046 10701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:13.732165 10701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:13.732266 10701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:13.738513 10701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:13.740397 10701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:13.741570 10701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:13.752242 10707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:13.752328 10701 server_base.cc:1034] running on GCE node
W20260806 16:57:13.752224 10710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:13.752413 10708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:13.753129 10701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:13.753836 10701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:13.755054 10701 hybrid_clock.cc:648] HybridClock initialized: now 1786035433755014 us; error 54 us; skew 500 ppm
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:13.758338 10701 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:13.759424 10701 webserver.cc:460] Webserver started at http://127.7.153.3:46003/ using document root <none> and password file <none>
I20260806 16:57:13.760543 10701 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:13.760612 10701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:13.760897 10701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:13.763337 10701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "33eea25941914f9c8c596cabf42169dc"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "2611ed4aaf757137e9770000e74cb9ea"
server_key_iv: "d74ab06b2ac1fb8f0e3bcf253a650dca"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.763916 10701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "33eea25941914f9c8c596cabf42169dc"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "2611ed4aaf757137e9770000e74cb9ea"
server_key_iv: "d74ab06b2ac1fb8f0e3bcf253a650dca"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.769066 10701 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260806 16:57:13.771896 10717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.773360 10701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:13.773509 10701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "33eea25941914f9c8c596cabf42169dc"
format_stamp: "Formatted at 2026-08-06 16:57:13 on dist-test-slave-cbsf"
server_key: "2611ed4aaf757137e9770000e74cb9ea"
server_key_iv: "d74ab06b2ac1fb8f0e3bcf253a650dca"
server_key_version: "encryptionkey@0"
I20260806 16:57:13.773641 10701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:13.793224 10701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:13.796736 10701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:13.796947 10701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:13.797645 10701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:13.798558 10701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:13.798616 10701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.798704 10701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:13.798740 10701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:13.808534 10701 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:35967
I20260806 16:57:13.808555 10838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:35967 every 8 connection(s)
I20260806 16:57:13.809670 10701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:13.812009 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 10701
I20260806 16:57:13.812146 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:13.812505 7780 external_mini_cluster.cc:1428] Setting key 0c3bc760855f5b1dc35d2a2acd6693c0
Aug 06 16:57:13 dist-test-slave-cbsf krb5kdc[10296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:13.825824 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.811707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:53455 (local address 127.7.153.62:37399)
0806 16:57:13.811855 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:13.811859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:13.813336 (+ 1477us) server_negotiation.cc:407] Connection header received
0806 16:57:13.814533 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:13.814536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:13.814593 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:13.814675 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:13.815975 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.816528 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.817842 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.818081 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.818206 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.821237 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:13.821242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:13.821244 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:13.821274 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:13.822894 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.823551 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.823555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.823556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.823725 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:13.824194 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:13.824200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:13.824205 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:13.824517 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:13.824641 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:13.825460 (+ 819us) server_negotiation.cc:299] Negotiation successful
0806 16:57:13.825644 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:13.827035 10841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:13.812196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:37399 (local address 127.7.153.3:53455)
0806 16:57:13.813189 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:13.813238 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:13.814285 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:13.814872 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:13.814880 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:13.815280 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:13.815815 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:13.815829 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.816669 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.816673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:13.817704 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:13.817715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:13.818259 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:13.818264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:13.818463 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:13.819125 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:13.819143 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:13.820995 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:13.823059 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:13.823067 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:13.823089 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:13.823418 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:13.823850 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:13.823853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:13.823855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:13.824035 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:13.824634 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:13.824640 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:13.825135 (+ 495us) client_negotiation.cc:769] Sending connection context
0806 16:57:13.825395 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 16:57:13.825820 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":163,"threads_started":1}
I20260806 16:57:13.828435 10839 heartbeater.cc:347] Connected to a master server at 127.7.153.62:37399
I20260806 16:57:13.828790 10839 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:13.829586 10839 heartbeater.cc:511] Master 127.7.153.62:37399 requested a full tablet report, sending...
I20260806 16:57:13.830862 10343 ts_manager.cc:194] Registered new tserver with Master: 33eea25941914f9c8c596cabf42169dc (127.7.153.3:35967)
I20260806 16:57:13.831578 10343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:53455
I20260806 16:57:13.839366 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 16:57:13.855830 10384 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:13.854088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45294 (local address 127.7.153.62:37399)
0806 16:57:13.854346 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:13.854350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:13.854461 (+ 111us) server_negotiation.cc:407] Connection header received
0806 16:57:13.854605 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:13.854607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:13.854653 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:13.854727 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:13.855649 (+ 922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45294: BlockingRecv error: recv got EOF from 127.0.0.1:45294 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
I20260806 16:57:13.857009 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 10411
I20260806 16:57:13.867153 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 10559
I20260806 16:57:13.876482 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 10701
I20260806 16:57:13.883855 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 10309
2026-08-06T16:57:13Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2344 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:15 dist-test-slave-cbsf krb5kdc[10852](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:15 dist-test-slave-cbsf krb5kdc[10852](info): set up 2 sockets
Aug 06 16:57:15 dist-test-slave-cbsf krb5kdc[10852](info): commencing operation
krb5kdc: starting...
W20260806 16:57:16.312732 7780 mini_kdc.cc:121] Time spent starting KDC: real 2.403s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:16 dist-test-slave-cbsf krb5kdc[10852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:16.469406 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:45927
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:36227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:45927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:16.596856 10866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:16.597190 10866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:16.597265 10866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:16.601552 10866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:16.601634 10866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:16.601655 10866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:16.601707 10866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:16.601745 10866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:16.607692 10866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:36227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:45927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:45927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:16.609076 10866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:16.610309 10866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:16.619952 10872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:16.619952 10873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:16.619967 10875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:16.620249 10866 server_base.cc:1034] running on GCE node
I20260806 16:57:16.621090 10866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:16.622488 10866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:16.623703 10866 hybrid_clock.cc:648] HybridClock initialized: now 1786035436623690 us; error 38 us; skew 500 ppm
Aug 06 16:57:16 dist-test-slave-cbsf krb5kdc[10852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035436, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:16.627398 10866 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:16.629088 10866 webserver.cc:460] Webserver started at http://127.7.153.62:41027/ using document root <none> and password file <none>
I20260806 16:57:16.629886 10866 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:16.630003 10866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:16.630281 10866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:16.632793 10866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "242c54a67df74cb896ca3ef05cc1d69f"
format_stamp: "Formatted at 2026-08-06 16:57:16 on dist-test-slave-cbsf"
server_key: "6ed2edd64d05d5c7f920cbb7767dbd60"
server_key_iv: "435e0efb0bf1bd4adc96d37796472162"
server_key_version: "encryptionkey@0"
I20260806 16:57:16.633479 10866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "242c54a67df74cb896ca3ef05cc1d69f"
format_stamp: "Formatted at 2026-08-06 16:57:16 on dist-test-slave-cbsf"
server_key: "6ed2edd64d05d5c7f920cbb7767dbd60"
server_key_iv: "435e0efb0bf1bd4adc96d37796472162"
server_key_version: "encryptionkey@0"
I20260806 16:57:16.637990 10866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:57:16.640971 10882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:16.642498 10866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 16:57:16.642693 10866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "242c54a67df74cb896ca3ef05cc1d69f"
format_stamp: "Formatted at 2026-08-06 16:57:16 on dist-test-slave-cbsf"
server_key: "6ed2edd64d05d5c7f920cbb7767dbd60"
server_key_iv: "435e0efb0bf1bd4adc96d37796472162"
server_key_version: "encryptionkey@0"
I20260806 16:57:16.642838 10866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:16.664482 10866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:16.667941 10866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:16.668190 10866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:16.676067 10866 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:45927
I20260806 16:57:16.676383 10935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:45927 every 8 connection(s)
I20260806 16:57:16.677325 10866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:16.678594 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 10866
I20260806 16:57:16.678720 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:16.679033 7780 external_mini_cluster.cc:1428] Setting key 44f8c7fc672fffedd30ae19d5c57974a
I20260806 16:57:16.680991 10937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:16.687412 10937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f: Bootstrap starting.
Aug 06 16:57:16 dist-test-slave-cbsf krb5kdc[10852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:16.690197 10937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:16.691002 10937 log.cc:824] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:16.693351 10937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f: No bootstrap required, opened a new log
I20260806 16:57:16.694041 10940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:16.680549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.7.153.62:45927)
0806 16:57:16.681142 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:16.681159 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:16.681196 (+ 37us) server_negotiation.cc:407] Connection header received
0806 16:57:16.681884 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:16.681900 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:16.682254 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:16.682635 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:16.683516 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:16.684571 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:16.685506 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:16.686008 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:16.686191 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:16.689004 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:16.689009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:16.689025 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:16.689058 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:16.690827 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:16.691373 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:16.691378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:16.691383 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:16.691503 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:16.691803 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:16.691807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:16.691809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:16.692260 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:16.692490 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:16.692834 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 16:57:16.693154 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":178,"threads_started":1}
I20260806 16:57:16.697453 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:57:16.698027 10937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242c54a67df74cb896ca3ef05cc1d69f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45927 } }
I20260806 16:57:16.698308 10937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:16.698369 10937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242c54a67df74cb896ca3ef05cc1d69f, State: Initialized, Role: FOLLOWER
I20260806 16:57:16.698825 10937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242c54a67df74cb896ca3ef05cc1d69f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45927 } }
I20260806 16:57:16.698983 10937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:16.699071 10937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:16.699195 10937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:16.700543 10937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242c54a67df74cb896ca3ef05cc1d69f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45927 } }
I20260806 16:57:16.701046 10937 leader_election.cc:302] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 242c54a67df74cb896ca3ef05cc1d69f; no voters:
I20260806 16:57:16.701500 10937 leader_election.cc:288] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:16.701647 10943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:16.701920 10943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [term 1 LEADER]: Becoming Leader. State: Replica: 242c54a67df74cb896ca3ef05cc1d69f, State: Running, Role: LEADER
I20260806 16:57:16.702318 10943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242c54a67df74cb896ca3ef05cc1d69f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45927 } }
I20260806 16:57:16.703069 10937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:16.704253 10944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "242c54a67df74cb896ca3ef05cc1d69f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242c54a67df74cb896ca3ef05cc1d69f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45927 } } }
I20260806 16:57:16.704253 10945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 242c54a67df74cb896ca3ef05cc1d69f. Latest consensus state: current_term: 1 leader_uuid: "242c54a67df74cb896ca3ef05cc1d69f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "242c54a67df74cb896ca3ef05cc1d69f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45927 } } }
I20260806 16:57:16.704429 10945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:16.704429 10944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:16.705322 10952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:16.709466 10952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:16.716753 10952 catalog_manager.cc:1347] Generated new cluster ID: f9d8c4d140e44d8f94ad79417ed1ba20
I20260806 16:57:16.716836 10952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:16.724792 10940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:16.718463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39268 (local address 127.7.153.62:45927)
0806 16:57:16.718609 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:16.718614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:16.718941 (+ 327us) server_negotiation.cc:407] Connection header received
0806 16:57:16.719061 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:16.719064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:16.719126 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:16.719226 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:16.719921 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:16.720809 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:16.722081 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:16.722451 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:16.722548 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:16.723577 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:16.723580 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:16.723583 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:16.724239 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:16.724280 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:16.724301 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:16.724395 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:16.724528 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 16:57:16.724601 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:16.743929 10952 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:16.745160 10952 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:16.756493 10952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 242c54a67df74cb896ca3ef05cc1d69f: Generated new TSK 0
I20260806 16:57:16.757681 10952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:57:16.768472 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 10866
2026-08-06T16:57:16Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2881 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:16 dist-test-slave-cbsf krb5kdc[10972](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:16 dist-test-slave-cbsf krb5kdc[10972](info): set up 2 sockets
Aug 06 16:57:16 dist-test-slave-cbsf krb5kdc[10972](info): commencing operation
krb5kdc: starting...
W20260806 16:57:17.868958 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:17 dist-test-slave-cbsf krb5kdc[10972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:18.008054 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41547
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:41547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:18.129995 10985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:18.130370 10985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:18.130451 10985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:18.134754 10985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:18.134877 10985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:18.134917 10985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:18.134956 10985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:18.134990 10985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:18.140834 10985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:41547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:18.142148 10985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:18.143270 10985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:18.152725 10990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.152729 10993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.152729 10991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:18.153211 10985 server_base.cc:1034] running on GCE node
I20260806 16:57:18.153909 10985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:18.155213 10985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:18.156411 10985 hybrid_clock.cc:648] HybridClock initialized: now 1786035438156390 us; error 36 us; skew 500 ppm
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:18.165649 10985 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:18.166745 10985 webserver.cc:460] Webserver started at http://127.7.153.62:40677/ using document root <none> and password file <none>
I20260806 16:57:18.167400 10985 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:18.167471 10985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:18.167670 10985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:18.170004 10985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "23c5b26a4513658096063a71579bd88e"
server_key_iv: "9b6fe2dbd1b823116b5552d1e3ee24a1"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.170598 10985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "23c5b26a4513658096063a71579bd88e"
server_key_iv: "9b6fe2dbd1b823116b5552d1e3ee24a1"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.174955 10985 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:18.177856 11001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.179301 10985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:18.179472 10985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "23c5b26a4513658096063a71579bd88e"
server_key_iv: "9b6fe2dbd1b823116b5552d1e3ee24a1"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.179621 10985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:18.193532 10985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:18.197278 10985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:18.197512 10985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:18.205372 10985 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:41547
I20260806 16:57:18.205681 11058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:41547 every 8 connection(s)
I20260806 16:57:18.206571 10985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:18.209753 11059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:18.216197 11059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e: Bootstrap starting.
I20260806 16:57:18.216727 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 10985
I20260806 16:57:18.216857 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:18.217200 7780 external_mini_cluster.cc:1428] Setting key 09ef98406f394faabc2c105b7db1f2a4
I20260806 16:57:18.219339 11059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:18.220141 11059 log.cc:824] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:18.222622 11059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e: No bootstrap required, opened a new log
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:18.227744 11059 raft_consensus.cc:348] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41547 } }
I20260806 16:57:18.228035 11059 raft_consensus.cc:374] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:18.228120 11059 raft_consensus.cc:729] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c215e5b3a14046c1aa71ce8d6ce1c73e, State: Initialized, Role: FOLLOWER
I20260806 16:57:18.228646 11059 consensus_queue.cc:260] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41547 } }
I20260806 16:57:18.228866 11059 raft_consensus.cc:388] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:18.228953 11059 raft_consensus.cc:482] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:18.229074 11059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:18.230482 11059 raft_consensus.cc:504] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41547 } }
I20260806 16:57:18.230929 11059 leader_election.cc:302] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c215e5b3a14046c1aa71ce8d6ce1c73e; no voters:
I20260806 16:57:18.231392 11059 leader_election.cc:288] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:18.231526 11065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:18.231796 11065 raft_consensus.cc:686] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [term 1 LEADER]: Becoming Leader. State: Replica: c215e5b3a14046c1aa71ce8d6ce1c73e, State: Running, Role: LEADER
I20260806 16:57:18.232244 11065 consensus_queue.cc:237] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41547 } }
I20260806 16:57:18.232918 11059 sys_catalog.cc:564] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:18.234308 11066 sys_catalog.cc:455] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41547 } } }
I20260806 16:57:18.234396 11067 sys_catalog.cc:455] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c215e5b3a14046c1aa71ce8d6ce1c73e. Latest consensus state: current_term: 1 leader_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c215e5b3a14046c1aa71ce8d6ce1c73e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41547 } } }
I20260806 16:57:18.234484 11066 sys_catalog.cc:458] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:18.234488 11067 sys_catalog.cc:458] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:18.234810 11063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.218747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.7.153.62:41547)
0806 16:57:18.219244 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:18.219261 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:18.219298 (+ 37us) server_negotiation.cc:407] Connection header received
0806 16:57:18.220091 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:18.220109 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:18.220538 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:18.220983 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:18.221919 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.223021 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.224237 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.224880 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.225027 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:18.228258 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:18.228267 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:18.228294 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:18.228334 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:18.230738 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:18.231277 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:18.231286 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:18.231294 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:18.231458 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:18.231884 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:18.231889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:18.231892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:18.232513 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:18.232734 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:18.233255 (+ 521us) server_negotiation.cc:299] Negotiation successful
0806 16:57:18.233595 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":158,"threads_started":1}
W20260806 16:57:18.238605 11081 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:18.238718 11081 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:18.238920 11076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:18.239677 11076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:18.246081 11076 catalog_manager.cc:1347] Generated new cluster ID: 950673ed68804eeda1aaed6f7ae68d9e
I20260806 16:57:18.246187 11076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:18.254657 11076 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:18.256059 11076 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:18.261173 11076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c215e5b3a14046c1aa71ce8d6ce1c73e: Generated new TSK 0
I20260806 16:57:18.262133 11076 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:18.300256 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41547
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:18.427000 11087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:18.427358 11087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:18.427443 11087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:18.431843 11087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:18.431973 11087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:18.432075 11087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:18.438342 11087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:18.439601 11087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:18.440755 11087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:18.451573 11093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:18.451712 11087 server_base.cc:1034] running on GCE node
W20260806 16:57:18.451617 11092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.451885 11095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:18.452415 11087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:18.453217 11087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:18.454427 11087 hybrid_clock.cc:648] HybridClock initialized: now 1786035438454410 us; error 30 us; skew 500 ppm
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:18.457880 11087 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:18.459082 11087 webserver.cc:460] Webserver started at http://127.7.153.1:34115/ using document root <none> and password file <none>
I20260806 16:57:18.459753 11087 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:18.459851 11087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:18.460106 11087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:18.462533 11087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "6481d62df8e3441e8f8d9455063f7999"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "ed742155845e96425427593599dd1646"
server_key_iv: "6cdc140dcf0d1307c3c4ec4b14318225"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.463186 11087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "6481d62df8e3441e8f8d9455063f7999"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "ed742155845e96425427593599dd1646"
server_key_iv: "6cdc140dcf0d1307c3c4ec4b14318225"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.467569 11087 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260806 16:57:18.470669 11102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.472223 11087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:18.472412 11087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "6481d62df8e3441e8f8d9455063f7999"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "ed742155845e96425427593599dd1646"
server_key_iv: "6cdc140dcf0d1307c3c4ec4b14318225"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.472561 11087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:18.485066 11087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:18.488667 11087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:18.488957 11087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:18.489642 11087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:18.490576 11087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:18.490653 11087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.490727 11087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:18.490774 11087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.500351 11087 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:37571
I20260806 16:57:18.500411 11224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:37571 every 8 connection(s)
I20260806 16:57:18.501462 11087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:18.509593 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11087
I20260806 16:57:18.509740 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:18.510070 7780 external_mini_cluster.cc:1428] Setting key c75e0b7fae74bc687e0d731fb3f73c6c
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:18.517632 11063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.503503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:48027 (local address 127.7.153.62:41547)
0806 16:57:18.503677 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:18.503681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:18.504559 (+ 878us) server_negotiation.cc:407] Connection header received
0806 16:57:18.506091 (+ 1532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:18.506094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:18.506155 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:18.506248 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:18.507586 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.508150 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.509469 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.509867 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.509990 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:18.512770 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:18.512777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:18.512783 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:18.512820 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:18.514674 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:18.515477 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:18.515480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:18.515481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:18.515594 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:18.516102 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:18.516105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:18.516107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:18.516339 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:18.516471 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:18.517303 (+ 832us) server_negotiation.cc:299] Negotiation successful
0806 16:57:18.517487 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 16:57:18.518981 11227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.503889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41547 (local address 127.7.153.1:48027)
0806 16:57:18.504388 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:18.504434 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:18.505864 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:18.506411 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:18.506418 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:18.506841 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:18.507415 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:18.507429 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.508289 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.508291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:18.509332 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:18.509343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.510035 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.510038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:18.510252 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:18.510920 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:18.510939 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:18.512544 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:18.514825 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:18.514837 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:18.514875 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:18.515326 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:18.515708 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:18.515714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:18.515719 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:18.515956 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:18.516464 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:18.516475 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:18.516938 (+ 463us) client_negotiation.cc:769] Sending connection context
0806 16:57:18.517222 (+ 284us) client_negotiation.cc:240] Negotiation successful
0806 16:57:18.517680 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":131,"threads_started":1}
I20260806 16:57:18.520663 11225 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41547
I20260806 16:57:18.521005 11225 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:18.521620 11225 heartbeater.cc:511] Master 127.7.153.62:41547 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:57:18.523535 11019 ts_manager.cc:194] Registered new tserver with Master: 6481d62df8e3441e8f8d9455063f7999 (127.7.153.1:37571)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:18.525036 11019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:48027
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:18.544800 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41547
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:18.665498 11230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:18.665832 11230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:18.665879 11230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:18.670156 11230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:18.670240 11230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:18.670305 11230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:18.676226 11230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:18.677561 11230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:18.678686 11230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:18.689234 11239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.689230 11236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.689229 11237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:18.689682 11230 server_base.cc:1034] running on GCE node
I20260806 16:57:18.690207 11230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:18.690917 11230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:18.692127 11230 hybrid_clock.cc:648] HybridClock initialized: now 1786035438692108 us; error 32 us; skew 500 ppm
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:18.695287 11230 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:18.696400 11230 webserver.cc:460] Webserver started at http://127.7.153.2:46261/ using document root <none> and password file <none>
I20260806 16:57:18.697084 11230 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:18.697204 11230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:18.697461 11230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:18.699960 11230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "310cb4e0287f440eb779f902ee1ca009"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "87306dbad01cc85f7c66959f88a3eb05"
server_key_iv: "af2d57753771884b73ffabec0066ad17"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.700600 11230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "310cb4e0287f440eb779f902ee1ca009"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "87306dbad01cc85f7c66959f88a3eb05"
server_key_iv: "af2d57753771884b73ffabec0066ad17"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.704825 11230 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:57:18.707643 11246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.709381 11230 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:18.709558 11230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "310cb4e0287f440eb779f902ee1ca009"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "87306dbad01cc85f7c66959f88a3eb05"
server_key_iv: "af2d57753771884b73ffabec0066ad17"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.709705 11230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:18.732399 11230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:18.736498 11230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:18.736783 11230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:18.737463 11230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:18.738389 11230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:18.738462 11230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.738536 11230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:18.738587 11230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.747753 11230 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34119
I20260806 16:57:18.747772 11368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34119 every 8 connection(s)
I20260806 16:57:18.748847 11230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:18.753513 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11230
I20260806 16:57:18.753635 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:18.753957 7780 external_mini_cluster.cc:1428] Setting key ad1a4790fa36e275564cbfb5a289c12f
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:18.767112 11063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.750909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:36537 (local address 127.7.153.62:41547)
0806 16:57:18.751060 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:18.751064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:18.752031 (+ 967us) server_negotiation.cc:407] Connection header received
0806 16:57:18.753835 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:18.753838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:18.753895 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:18.753974 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:18.755513 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.756448 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.758515 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.758984 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.759142 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:18.761946 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:18.761953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:18.761957 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:18.762004 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:18.764120 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:18.764926 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:18.764931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:18.764934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:18.765067 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:18.765517 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:18.765522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:18.765524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:18.765879 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:18.766025 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:18.766662 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 16:57:18.766854 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:57:18.768061 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.751320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41547 (local address 127.7.153.2:36537)
0806 16:57:18.751848 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:18.751894 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:18.753548 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:18.754185 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:18.754196 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:18.754646 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:18.755264 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:18.755286 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.756640 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.756647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:18.758296 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:18.758313 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:18.759180 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:18.759183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:18.759346 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:18.760001 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:18.760020 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:18.761703 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:18.764315 (+ 2612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:18.764322 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:18.764342 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:18.764776 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:18.765185 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:18.765187 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:18.765189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:18.765381 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:18.766011 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:18.766017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:18.766335 (+ 318us) client_negotiation.cc:769] Sending connection context
0806 16:57:18.766524 (+ 189us) client_negotiation.cc:240] Negotiation successful
0806 16:57:18.766864 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":147,"threads_started":1}
I20260806 16:57:18.769776 11369 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41547
I20260806 16:57:18.770119 11369 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:18.770886 11369 heartbeater.cc:511] Master 127.7.153.62:41547 requested a full tablet report, sending...
I20260806 16:57:18.772406 11019 ts_manager.cc:194] Registered new tserver with Master: 310cb4e0287f440eb779f902ee1ca009 (127.7.153.2:34119)
I20260806 16:57:18.773283 11019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:36537
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:18.790014 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41547
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:18.918323 11374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:18.918668 11374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:18.918718 11374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:18.923019 11374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:18.923105 11374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:18.923171 11374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:18.929222 11374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:18.930548 11374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:18.931712 11374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:18.942654 11384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.942654 11380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:18.942655 11379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:18.942888 11374 server_base.cc:1034] running on GCE node
I20260806 16:57:18.943394 11374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:18.944092 11374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:18.945263 11374 hybrid_clock.cc:648] HybridClock initialized: now 1786035438945232 us; error 53 us; skew 500 ppm
Aug 06 16:57:18 dist-test-slave-cbsf krb5kdc[10972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:18.948345 11374 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:18.949375 11374 webserver.cc:460] Webserver started at http://127.7.153.3:38739/ using document root <none> and password file <none>
I20260806 16:57:18.950053 11374 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:18.950129 11374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:18.950377 11374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:18.952586 11374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "f5d72a91efb64339aa2923ab5ae09659"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "8cfd82155c776a6fdf3590deaaff2806"
server_key_iv: "a65295658eac2324cf5a04fb9d13ecb9"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.953218 11374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "f5d72a91efb64339aa2923ab5ae09659"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "8cfd82155c776a6fdf3590deaaff2806"
server_key_iv: "a65295658eac2324cf5a04fb9d13ecb9"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.957265 11374 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:18.959992 11391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.961408 11374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:18.961565 11374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "f5d72a91efb64339aa2923ab5ae09659"
format_stamp: "Formatted at 2026-08-06 16:57:18 on dist-test-slave-cbsf"
server_key: "8cfd82155c776a6fdf3590deaaff2806"
server_key_iv: "a65295658eac2324cf5a04fb9d13ecb9"
server_key_version: "encryptionkey@0"
I20260806 16:57:18.961696 11374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:18.977246 11374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:18.980922 11374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:18.981153 11374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:18.981793 11374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:18.982764 11374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:18.982831 11374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.982894 11374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:18.982947 11374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:18.993204 11374 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:40911
I20260806 16:57:18.993229 11510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:40911 every 8 connection(s)
I20260806 16:57:18.994246 11374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:18.999239 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11374
I20260806 16:57:18.999394 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:18.999760 7780 external_mini_cluster.cc:1428] Setting key a6d7a83f765d4045f51fbaf480d5022c
Aug 06 16:57:19 dist-test-slave-cbsf krb5kdc[10972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035438, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:19.011089 11063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.996515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:50451 (local address 127.7.153.62:41547)
0806 16:57:18.997002 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:18.997007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:18.997966 (+ 959us) server_negotiation.cc:407] Connection header received
0806 16:57:18.999901 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:18.999905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:18.999978 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:19.000038 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:19.002097 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:19.002859 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:19.004121 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:19.004440 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:19.004566 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:19.007454 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:19.007457 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:19.007460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:19.007489 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:19.008978 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:19.009538 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:19.009540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:19.009541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:19.009617 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:19.009977 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:19.009980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:19.009981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:19.010175 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:19.010251 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:19.010844 (+ 593us) server_negotiation.cc:299] Negotiation successful
0806 16:57:19.010958 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368}
I20260806 16:57:19.012095 11513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:18.996985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41547 (local address 127.7.153.3:50451)
0806 16:57:18.997771 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:18.997838 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:18.999553 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:19.000548 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:19.000560 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:19.001180 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:19.001942 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:19.001965 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:19.003003 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:19.003007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:19.003989 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:19.004000 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:19.004614 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:19.004617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:19.004881 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:19.005569 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:19.005588 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:19.007253 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:19.009100 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:19.009107 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:19.009123 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:19.009437 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:19.009726 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:19.009729 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:19.009730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:19.009886 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:19.010293 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:19.010300 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:19.010603 (+ 303us) client_negotiation.cc:769] Sending connection context
0806 16:57:19.010784 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 16:57:19.011096 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":188,"threads_started":1}
I20260806 16:57:19.013602 11511 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41547
I20260806 16:57:19.014377 11511 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:19.015153 11511 heartbeater.cc:511] Master 127.7.153.62:41547 requested a full tablet report, sending...
I20260806 16:57:19.016316 11019 ts_manager.cc:194] Registered new tserver with Master: f5d72a91efb64339aa2923ab5ae09659 (127.7.153.3:40911)
I20260806 16:57:19.017011 11019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:50451
I20260806 16:57:19.027616 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 16:57:19 dist-test-slave-cbsf krb5kdc[10972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035439, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 16:57:19 dist-test-slave-cbsf krb5kdc[10972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035439, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:19.058485 11063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:19.049290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39250 (local address 127.7.153.62:41547)
0806 16:57:19.049454 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:19.049458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:19.049630 (+ 172us) server_negotiation.cc:407] Connection header received
0806 16:57:19.049751 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:19.049754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:19.049801 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:19.049886 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:19.050640 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:19.051187 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:19.052069 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:19.052304 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:19.052417 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:19.055128 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:19.055132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:19.055134 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:19.055168 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:19.056778 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:19.057254 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:19.057257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:19.057258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:19.057348 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:19.057608 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:19.057610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:19.057611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:19.057887 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:19.058001 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:19.058232 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 16:57:19.058348 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 16:57:19.059000 11019 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39250
I20260806 16:57:19.060138 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11087
I20260806 16:57:19.071709 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11230
I20260806 16:57:19.079159 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11374
I20260806 16:57:19.087410 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 10985
2026-08-06T16:57:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2322 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:19 dist-test-slave-cbsf krb5kdc[11523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:19 dist-test-slave-cbsf krb5kdc[11523](info): set up 2 sockets
Aug 06 16:57:19 dist-test-slave-cbsf krb5kdc[11523](info): commencing operation
krb5kdc: starting...
W20260806 16:57:20.192487 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:20 dist-test-slave-cbsf krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:20.331835 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:46475
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:46475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:20.455479 11537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:20.455874 11537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:20.455953 11537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:20.460654 11537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:20.460922 11537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:20.460966 11537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:20.461014 11537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:20.461056 11537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:20.467289 11537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:46475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:46475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:20.468663 11537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:20.470325 11537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:20.480204 11545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:20.480224 11543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:20.480204 11542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:20.480440 11537 server_base.cc:1034] running on GCE node
I20260806 16:57:20.481276 11537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:20.482568 11537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:20.483817 11537 hybrid_clock.cc:648] HybridClock initialized: now 1786035440483804 us; error 31 us; skew 500 ppm
Aug 06 16:57:20 dist-test-slave-cbsf krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035440, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:20.487063 11537 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:20.488085 11537 webserver.cc:460] Webserver started at http://127.7.153.62:44663/ using document root <none> and password file <none>
I20260806 16:57:20.488802 11537 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:20.488878 11537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:20.489073 11537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:20.491369 11537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "44642f7cd0d34978937f4a7b547b28cb"
format_stamp: "Formatted at 2026-08-06 16:57:20 on dist-test-slave-cbsf"
server_key: "eca71bbee0b9fc1c8ad31f530355ba48"
server_key_iv: "05dc356af7084138121f08370db8a819"
server_key_version: "encryptionkey@0"
I20260806 16:57:20.491958 11537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "44642f7cd0d34978937f4a7b547b28cb"
format_stamp: "Formatted at 2026-08-06 16:57:20 on dist-test-slave-cbsf"
server_key: "eca71bbee0b9fc1c8ad31f530355ba48"
server_key_iv: "05dc356af7084138121f08370db8a819"
server_key_version: "encryptionkey@0"
I20260806 16:57:20.496953 11537 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 16:57:20.501483 11552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:20.503063 11537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 16:57:20.503242 11537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "44642f7cd0d34978937f4a7b547b28cb"
format_stamp: "Formatted at 2026-08-06 16:57:20 on dist-test-slave-cbsf"
server_key: "eca71bbee0b9fc1c8ad31f530355ba48"
server_key_iv: "05dc356af7084138121f08370db8a819"
server_key_version: "encryptionkey@0"
I20260806 16:57:20.503389 11537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:20.528216 11537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:20.532287 11537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:20.532531 11537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:20.541143 11537 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:46475
I20260806 16:57:20.541165 11607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:46475 every 8 connection(s)
I20260806 16:57:20.542279 11537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:20.545615 11608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:20.551159 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11537
I20260806 16:57:20.551322 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:20.551632 7780 external_mini_cluster.cc:1428] Setting key c68d3194ca93d636a0f93579297f9062
I20260806 16:57:20.553018 11608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb: Bootstrap starting.
I20260806 16:57:20.556128 11608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:20.557196 11608 log.cc:824] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:20.559860 11608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb: No bootstrap required, opened a new log
Aug 06 16:57:20 dist-test-slave-cbsf krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:20.564363 11608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44642f7cd0d34978937f4a7b547b28cb" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46475 } }
I20260806 16:57:20.564778 11608 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:20.564838 11608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44642f7cd0d34978937f4a7b547b28cb, State: Initialized, Role: FOLLOWER
I20260806 16:57:20.565409 11608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44642f7cd0d34978937f4a7b547b28cb" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46475 } }
I20260806 16:57:20.565599 11608 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:20.565686 11608 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:20.565789 11608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:20.567036 11608 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44642f7cd0d34978937f4a7b547b28cb" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46475 } }
I20260806 16:57:20.567441 11608 leader_election.cc:302] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44642f7cd0d34978937f4a7b547b28cb; no voters:
I20260806 16:57:20.567863 11608 leader_election.cc:288] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:20.568105 11614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:20.568427 11614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [term 1 LEADER]: Becoming Leader. State: Replica: 44642f7cd0d34978937f4a7b547b28cb, State: Running, Role: LEADER
I20260806 16:57:20.568874 11614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44642f7cd0d34978937f4a7b547b28cb" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46475 } }
I20260806 16:57:20.569386 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:20.553360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55574 (local address 127.7.153.62:46475)
0806 16:57:20.554012 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:20.554041 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:20.554081 (+ 40us) server_negotiation.cc:407] Connection header received
0806 16:57:20.554816 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:20.554836 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:20.555206 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:20.555510 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:20.556641 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:20.557955 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:20.559205 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:20.559929 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:20.560115 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:20.563313 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:20.563321 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:20.563349 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:20.563394 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:20.565523 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:20.566260 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:20.566267 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:20.566274 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:20.566427 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:20.566743 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:20.566747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:20.566749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:20.567371 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:20.567584 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:20.567951 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 16:57:20.568314 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":339,"threads_started":1}
I20260806 16:57:20.569396 11608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:20.570662 11615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44642f7cd0d34978937f4a7b547b28cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44642f7cd0d34978937f4a7b547b28cb" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46475 } } }
I20260806 16:57:20.570806 11615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:20.571144 11616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44642f7cd0d34978937f4a7b547b28cb. Latest consensus state: current_term: 1 leader_uuid: "44642f7cd0d34978937f4a7b547b28cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44642f7cd0d34978937f4a7b547b28cb" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46475 } } }
I20260806 16:57:20.571237 11616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb [sys.catalog]: This master's current role is: LEADER
W20260806 16:57:20.575543 11629 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:20.575659 11629 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:20.575768 11623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:20.576581 11623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:20.582726 11623 catalog_manager.cc:1347] Generated new cluster ID: 3f109e98d8ed4ff5bd11cea18e8c481a
I20260806 16:57:20.582844 11623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:20.603869 11623 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:20.605062 11623 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:20.613832 11623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44642f7cd0d34978937f4a7b547b28cb: Generated new TSK 0
I20260806 16:57:20.614701 11623 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:20.652887 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46475
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:20.776010 11635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:20.776327 11635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:20.776373 11635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:20.780812 11635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:20.780886 11635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:20.781000 11635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:20.786648 11635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:20.787850 11635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:20.788985 11635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:20.799600 11640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:20.799602 11641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:20.799777 11635 server_base.cc:1034] running on GCE node
W20260806 16:57:20.799986 11643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:20.800521 11635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:20.801321 11635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:20.802501 11635 hybrid_clock.cc:648] HybridClock initialized: now 1786035440802469 us; error 47 us; skew 500 ppm
Aug 06 16:57:20 dist-test-slave-cbsf krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035440, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:20.807041 11635 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:20.808444 11635 webserver.cc:460] Webserver started at http://127.7.153.1:33311/ using document root <none> and password file <none>
I20260806 16:57:20.809302 11635 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:20.809415 11635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:20.809706 11635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:20.812776 11635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "b293ac4034ce4feeaee3a36018d1517c"
format_stamp: "Formatted at 2026-08-06 16:57:20 on dist-test-slave-cbsf"
server_key: "86b87dd1645d7ee4ef139d0f6f346dfd"
server_key_iv: "795e761a4d8f6f4f4dfde17060befcf8"
server_key_version: "encryptionkey@0"
I20260806 16:57:20.813370 11635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "b293ac4034ce4feeaee3a36018d1517c"
format_stamp: "Formatted at 2026-08-06 16:57:20 on dist-test-slave-cbsf"
server_key: "86b87dd1645d7ee4ef139d0f6f346dfd"
server_key_iv: "795e761a4d8f6f4f4dfde17060befcf8"
server_key_version: "encryptionkey@0"
I20260806 16:57:20.817672 11635 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:57:20.821012 11650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:20.822494 11635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 16:57:20.822621 11635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "b293ac4034ce4feeaee3a36018d1517c"
format_stamp: "Formatted at 2026-08-06 16:57:20 on dist-test-slave-cbsf"
server_key: "86b87dd1645d7ee4ef139d0f6f346dfd"
server_key_iv: "795e761a4d8f6f4f4dfde17060befcf8"
server_key_version: "encryptionkey@0"
I20260806 16:57:20.822749 11635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:20.836879 11635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:20.840437 11635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:20.840622 11635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:20.841300 11635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:20.842178 11635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:20.842226 11635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:20.842267 11635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:20.842283 11635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:20.851846 11635 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:35773
I20260806 16:57:20.851864 11771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:35773 every 8 connection(s)
I20260806 16:57:20.852885 11635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:20.861860 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11635
I20260806 16:57:20.862027 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:20.862339 7780 external_mini_cluster.cc:1428] Setting key ac9257fb4e7754cec539b725451e47d7
Aug 06 16:57:20 dist-test-slave-cbsf krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035440, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:20.869030 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:20.854804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:36099 (local address 127.7.153.62:46475)
0806 16:57:20.854949 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:20.854953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:20.855806 (+ 853us) server_negotiation.cc:407] Connection header received
0806 16:57:20.857405 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:20.857408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:20.857471 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:20.857582 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:20.858887 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:20.859446 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:20.860716 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:20.860971 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:20.861094 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:20.864200 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:20.864204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:20.864206 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:20.864241 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:20.866217 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:20.867057 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:20.867060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:20.867061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:20.867149 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:20.867585 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:20.867588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:20.867589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:20.867782 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:20.867860 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:20.868523 (+ 663us) server_negotiation.cc:299] Negotiation successful
0806 16:57:20.868686 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 16:57:20.869895 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:20.855135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46475 (local address 127.7.153.1:36099)
0806 16:57:20.855635 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:20.855681 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:20.857168 (+ 1487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:20.857771 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:20.857779 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:20.858180 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:20.858711 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:20.858725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:20.859599 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:20.859603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:20.860553 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:20.860563 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:20.861150 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:20.861154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:20.861339 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:20.862089 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:20.862115 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:20.864008 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:20.866402 (+ 2394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:20.866413 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:20.866437 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:20.866931 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:20.867245 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:20.867250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:20.867253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:20.867487 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:20.867891 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:20.867901 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:20.868251 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 16:57:20.868436 (+ 185us) client_negotiation.cc:240] Negotiation successful
0806 16:57:20.868811 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":127,"threads_started":1}
I20260806 16:57:20.871387 11772 heartbeater.cc:347] Connected to a master server at 127.7.153.62:46475
I20260806 16:57:20.871748 11772 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:20.872490 11772 heartbeater.cc:511] Master 127.7.153.62:46475 requested a full tablet report, sending...
I20260806 16:57:20.874490 11569 ts_manager.cc:194] Registered new tserver with Master: b293ac4034ce4feeaee3a36018d1517c (127.7.153.1:35773)
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:57:20.875916 11569 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:36099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:20.896546 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46475
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:21.025975 11777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:21.026381 11777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:21.026469 11777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:21.030891 11777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:21.031008 11777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:21.031119 11777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:21.036999 11777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:21.038288 11777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:21.039412 11777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:21.050275 11785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:21.050263 11783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:21.050339 11777 server_base.cc:1034] running on GCE node
W20260806 16:57:21.050262 11782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:21.051039 11777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:21.051827 11777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:21.053006 11777 hybrid_clock.cc:648] HybridClock initialized: now 1786035441052984 us; error 35 us; skew 500 ppm
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:21.056226 11777 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:21.057402 11777 webserver.cc:460] Webserver started at http://127.7.153.2:36759/ using document root <none> and password file <none>
I20260806 16:57:21.058060 11777 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:21.058162 11777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:21.058422 11777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:21.060772 11777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "49a9dbc7c21449d3a6f0da089bfa6547"
format_stamp: "Formatted at 2026-08-06 16:57:21 on dist-test-slave-cbsf"
server_key: "8fdb036c6eb2b45178cf42d8c721e026"
server_key_iv: "1911cf634adeb1d31fba555c770552c0"
server_key_version: "encryptionkey@0"
I20260806 16:57:21.061403 11777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "49a9dbc7c21449d3a6f0da089bfa6547"
format_stamp: "Formatted at 2026-08-06 16:57:21 on dist-test-slave-cbsf"
server_key: "8fdb036c6eb2b45178cf42d8c721e026"
server_key_iv: "1911cf634adeb1d31fba555c770552c0"
server_key_version: "encryptionkey@0"
I20260806 16:57:21.066049 11777 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:21.069397 11792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:21.071255 11777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 16:57:21.071429 11777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "49a9dbc7c21449d3a6f0da089bfa6547"
format_stamp: "Formatted at 2026-08-06 16:57:21 on dist-test-slave-cbsf"
server_key: "8fdb036c6eb2b45178cf42d8c721e026"
server_key_iv: "1911cf634adeb1d31fba555c770552c0"
server_key_version: "encryptionkey@0"
I20260806 16:57:21.071593 11777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:21.106254 11777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:21.110021 11777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:21.110222 11777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:21.110810 11777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:21.111697 11777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:21.111747 11777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:21.111791 11777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:21.111811 11777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:21.121572 11777 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:37583
I20260806 16:57:21.121634 11908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:37583 every 8 connection(s)
I20260806 16:57:21.122658 11777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:21.125840 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11777
I20260806 16:57:21.125967 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:21.126268 7780 external_mini_cluster.cc:1428] Setting key a5f1294644989e7b52e568f2ed0bca0c
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:57:21.139209 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:21.124777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:59155 (local address 127.7.153.62:46475)
0806 16:57:21.124969 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:21.124973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:21.125902 (+ 929us) server_negotiation.cc:407] Connection header received
0806 16:57:21.127582 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:21.127586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:21.127642 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:21.127754 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:21.129070 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.129614 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.130835 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.131062 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.131188 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:21.134464 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:21.134468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:21.134470 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:21.134499 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:21.136123 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.136946 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.136949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.136951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.137037 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.137488 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.137490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.137491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.137773 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:21.137857 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:21.138901 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0806 16:57:21.139070 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 16:57:21.139801 11911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:21.125151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46475 (local address 127.7.153.2:59155)
0806 16:57:21.125696 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:21.125784 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:21.127348 (+ 1564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:21.127945 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:21.127952 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:21.128337 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:21.128922 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:21.128939 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.129762 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.129766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:21.130699 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:21.130709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.131237 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.131241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:21.131427 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:21.132108 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:21.132126 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:21.134219 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:21.136268 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:21.136279 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:21.136318 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:21.136805 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:21.137143 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:21.137167 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:21.137169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:21.137382 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:21.137894 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:21.137905 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:21.138239 (+ 334us) client_negotiation.cc:769] Sending connection context
0806 16:57:21.138422 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 16:57:21.138791 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:21.141367 11909 heartbeater.cc:347] Connected to a master server at 127.7.153.62:46475
I20260806 16:57:21.141669 11909 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:21.142346 11909 heartbeater.cc:511] Master 127.7.153.62:46475 requested a full tablet report, sending...
I20260806 16:57:21.143841 11569 ts_manager.cc:194] Registered new tserver with Master: 49a9dbc7c21449d3a6f0da089bfa6547 (127.7.153.2:37583)
I20260806 16:57:21.144469 11569 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:59155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:21.161096 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46475
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:21.283496 11914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:21.283867 11914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:21.283948 11914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:21.288484 11914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:21.288589 11914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:21.288733 11914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:21.294657 11914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:21.295930 11914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:21.297127 11914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:21.307886 11919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:21.307874 11922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:21.307875 11920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:21.308314 11914 server_base.cc:1034] running on GCE node
I20260806 16:57:21.308919 11914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:21.309686 11914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:21.310859 11914 hybrid_clock.cc:648] HybridClock initialized: now 1786035441310836 us; error 33 us; skew 500 ppm
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:21.313971 11914 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:21.315049 11914 webserver.cc:460] Webserver started at http://127.7.153.3:40197/ using document root <none> and password file <none>
I20260806 16:57:21.315675 11914 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:21.315773 11914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:21.316025 11914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:21.318395 11914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "d80a219983a64d8d81d7189df18b3105"
format_stamp: "Formatted at 2026-08-06 16:57:21 on dist-test-slave-cbsf"
server_key: "9cec75230f25670b070c383334abf03c"
server_key_iv: "48ddeacbebfe00635a19c1032f93b88a"
server_key_version: "encryptionkey@0"
I20260806 16:57:21.319015 11914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "d80a219983a64d8d81d7189df18b3105"
format_stamp: "Formatted at 2026-08-06 16:57:21 on dist-test-slave-cbsf"
server_key: "9cec75230f25670b070c383334abf03c"
server_key_iv: "48ddeacbebfe00635a19c1032f93b88a"
server_key_version: "encryptionkey@0"
I20260806 16:57:21.323189 11914 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:21.326048 11929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:21.327476 11914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:57:21.327627 11914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "d80a219983a64d8d81d7189df18b3105"
format_stamp: "Formatted at 2026-08-06 16:57:21 on dist-test-slave-cbsf"
server_key: "9cec75230f25670b070c383334abf03c"
server_key_iv: "48ddeacbebfe00635a19c1032f93b88a"
server_key_version: "encryptionkey@0"
I20260806 16:57:21.327759 11914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:21.342195 11914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:21.345875 11914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:21.346066 11914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:21.346665 11914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:21.347533 11914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:21.347581 11914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:21.347625 11914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:21.347640 11914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:21.357628 11914 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:35891
I20260806 16:57:21.357651 12050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:35891 every 8 connection(s)
I20260806 16:57:21.358667 11914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:21.359928 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 11914
I20260806 16:57:21.360081 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:21.360419 7780 external_mini_cluster.cc:1428] Setting key b6c65f09250f4d212d2612191e81da16
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:21.375264 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:21.360921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:46367 (local address 127.7.153.62:46475)
0806 16:57:21.361077 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:21.361082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:21.362217 (+ 1135us) server_negotiation.cc:407] Connection header received
0806 16:57:21.363854 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:21.363858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:21.363919 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:21.363997 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:21.365351 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.365910 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.367166 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.367398 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.367509 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:21.370833 (+ 3324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:21.370841 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:21.370846 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:21.370888 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:21.372514 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.373284 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.373288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.373290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.373393 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.373892 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.373896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.373897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.374160 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:21.374270 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:21.375027 (+ 757us) server_negotiation.cc:299] Negotiation successful
0806 16:57:21.375141 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 16:57:21.376298 12053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:21.361466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46475 (local address 127.7.153.3:46367)
0806 16:57:21.362073 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:21.362120 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:21.363608 (+ 1488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:21.364201 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:21.364209 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:21.364595 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:21.365202 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:21.365216 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.366066 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.366070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:21.367007 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:21.367017 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.367563 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.367568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:21.367757 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:21.368354 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:21.368372 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:21.370458 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:21.372642 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:21.372648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:21.372666 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:21.373142 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:21.373527 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:21.373530 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:21.373532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:21.373761 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:21.374300 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:21.374308 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:21.374701 (+ 393us) client_negotiation.cc:769] Sending connection context
0806 16:57:21.374955 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 16:57:21.375281 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":179,"threads_started":1}
I20260806 16:57:21.377486 12051 heartbeater.cc:347] Connected to a master server at 127.7.153.62:46475
I20260806 16:57:21.377772 12051 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:21.378356 12051 heartbeater.cc:511] Master 127.7.153.62:46475 requested a full tablet report, sending...
I20260806 16:57:21.379503 11569 ts_manager.cc:194] Registered new tserver with Master: d80a219983a64d8d81d7189df18b3105 (127.7.153.3:35891)
I20260806 16:57:21.380134 11569 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:46367
I20260806 16:57:21.387140 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:21.417071 12058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:21.406554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38228 (local address 127.7.153.1:35773)
0806 16:57:21.406984 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:21.406991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:21.407034 (+ 43us) server_negotiation.cc:407] Connection header received
0806 16:57:21.407110 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:21.407116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:21.407362 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:21.407491 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:21.408280 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.409158 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.410040 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.410449 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.410542 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:21.413250 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:21.413263 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:21.413279 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:21.413306 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:21.415014 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.415541 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.415548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.415549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.415638 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.415922 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.415925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.415927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.416222 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:21.416452 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:21.416673 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 16:57:21.416878 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":139,"threads_started":1}
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[11523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:21.430362 11612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:21.420832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55588 (local address 127.7.153.62:46475)
0806 16:57:21.421073 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:21.421080 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:21.421365 (+ 285us) server_negotiation.cc:407] Connection header received
0806 16:57:21.421439 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:21.421442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:21.421499 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:21.421590 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:21.422284 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.422818 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.423641 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:21.423868 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:21.423958 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:21.426857 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:21.426860 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:21.426863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:21.426894 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:21.428477 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.428986 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.428988 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.428990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.429070 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:21.429431 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:21.429433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:21.429434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:21.429684 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:21.429792 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:21.430024 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 16:57:21.430139 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260806 16:57:21.430856 11569 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55588
I20260806 16:57:21.431627 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11635
I20260806 16:57:21.439989 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11777
I20260806 16:57:21.447937 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11914
I20260806 16:57:21.456557 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 11537
2026-08-06T16:57:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2369 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[12063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[12063](info): set up 2 sockets
Aug 06 16:57:21 dist-test-slave-cbsf krb5kdc[12063](info): commencing operation
krb5kdc: starting...
W20260806 16:57:22.546713 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:22 dist-test-slave-cbsf krb5kdc[12063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:22.689165 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34385
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:22.814599 12077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:22.814934 12077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:22.814980 12077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:22.819222 12077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:22.819303 12077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:22.819322 12077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:22.819340 12077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:22.819355 12077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:22.825367 12077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:22.826586 12077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:22.827615 12077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:22.836568 12082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:22.836568 12083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:22.836714 12085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:22.837001 12077 server_base.cc:1034] running on GCE node
I20260806 16:57:22.837684 12077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:22.838973 12077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:22.840149 12077 hybrid_clock.cc:648] HybridClock initialized: now 1786035442840130 us; error 38 us; skew 500 ppm
Aug 06 16:57:22 dist-test-slave-cbsf krb5kdc[12063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035442, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:22.843339 12077 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:22.844247 12077 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:22.844323 12077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:22.844564 12077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:22.846864 12077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "df11e86a1b114f46a2249e708cd01bea"
format_stamp: "Formatted at 2026-08-06 16:57:22 on dist-test-slave-cbsf"
server_key: "daecf0264d24720bf759f885fc8254c9"
server_key_iv: "1efba2d606c45d01482ce68a34895fb5"
server_key_version: "encryptionkey@0"
I20260806 16:57:22.847491 12077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "df11e86a1b114f46a2249e708cd01bea"
format_stamp: "Formatted at 2026-08-06 16:57:22 on dist-test-slave-cbsf"
server_key: "daecf0264d24720bf759f885fc8254c9"
server_key_iv: "1efba2d606c45d01482ce68a34895fb5"
server_key_version: "encryptionkey@0"
I20260806 16:57:22.851640 12077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:22.854480 12091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:22.855954 12077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 16:57:22.856148 12077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "df11e86a1b114f46a2249e708cd01bea"
format_stamp: "Formatted at 2026-08-06 16:57:22 on dist-test-slave-cbsf"
server_key: "daecf0264d24720bf759f885fc8254c9"
server_key_iv: "1efba2d606c45d01482ce68a34895fb5"
server_key_version: "encryptionkey@0"
I20260806 16:57:22.856288 12077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:22.870673 12077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:22.874465 12077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:22.874724 12077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:22.882661 12077 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34385
I20260806 16:57:22.882994 12147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34385 every 8 connection(s)
I20260806 16:57:22.883455 12077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:22.886742 12148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:22.887800 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12077
I20260806 16:57:22.887943 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:22.888274 7780 external_mini_cluster.cc:1428] Setting key f0c6da0c670e5821dd73d2afd6a87ee3
I20260806 16:57:22.894595 12148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea: Bootstrap starting.
I20260806 16:57:22.897601 12148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea: Neither blocks nor log segments found. Creating new log.
Aug 06 16:57:22 dist-test-slave-cbsf krb5kdc[12063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:22.898679 12148 log.cc:824] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:22.901289 12148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea: No bootstrap required, opened a new log
I20260806 16:57:22.904291 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:22.889944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41054 (local address 127.7.153.62:34385)
0806 16:57:22.890501 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:22.890519 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:22.890559 (+ 40us) server_negotiation.cc:407] Connection header received
0806 16:57:22.891314 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:22.891334 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:22.891710 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:22.892099 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:22.893077 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:22.894155 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:22.895158 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:22.895696 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:22.895904 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:22.899023 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:22.899029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:22.899054 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:22.899089 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:22.901136 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:22.901698 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:22.901703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:22.901709 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:22.901827 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:22.902133 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:22.902136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:22.902137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:22.902576 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:22.902728 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:22.903089 (+ 361us) server_negotiation.cc:299] Negotiation successful
0806 16:57:22.903464 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":176,"threads_started":1}
I20260806 16:57:22.905828 12148 raft_consensus.cc:348] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df11e86a1b114f46a2249e708cd01bea" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34385 } }
I20260806 16:57:22.906147 12148 raft_consensus.cc:374] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:22.906204 12148 raft_consensus.cc:729] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df11e86a1b114f46a2249e708cd01bea, State: Initialized, Role: FOLLOWER
I20260806 16:57:22.906678 12148 consensus_queue.cc:260] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df11e86a1b114f46a2249e708cd01bea" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34385 } }
I20260806 16:57:22.906840 12148 raft_consensus.cc:388] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:22.906903 12148 raft_consensus.cc:482] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:22.907017 12148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:22.908056 12148 raft_consensus.cc:504] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df11e86a1b114f46a2249e708cd01bea" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34385 } }
I20260806 16:57:22.908421 12148 leader_election.cc:302] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df11e86a1b114f46a2249e708cd01bea; no voters:
I20260806 16:57:22.908806 12148 leader_election.cc:288] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:22.908969 12153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:22.909231 12153 raft_consensus.cc:686] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [term 1 LEADER]: Becoming Leader. State: Replica: df11e86a1b114f46a2249e708cd01bea, State: Running, Role: LEADER
I20260806 16:57:22.909543 12153 consensus_queue.cc:237] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df11e86a1b114f46a2249e708cd01bea" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34385 } }
I20260806 16:57:22.910260 12148 sys_catalog.cc:564] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:22.911473 12154 sys_catalog.cc:455] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df11e86a1b114f46a2249e708cd01bea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df11e86a1b114f46a2249e708cd01bea" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34385 } } }
I20260806 16:57:22.911531 12155 sys_catalog.cc:455] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [sys.catalog]: SysCatalogTable state changed. Reason: New leader df11e86a1b114f46a2249e708cd01bea. Latest consensus state: current_term: 1 leader_uuid: "df11e86a1b114f46a2249e708cd01bea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df11e86a1b114f46a2249e708cd01bea" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34385 } } }
I20260806 16:57:22.911669 12155 sys_catalog.cc:458] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:22.911604 12154 sys_catalog.cc:458] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:22.912108 12162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:22.915341 12162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:22.922456 12162 catalog_manager.cc:1347] Generated new cluster ID: ac51ec2f6c9349baa90a5d47ca96581b
I20260806 16:57:22.922586 12162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:22.940320 12162 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:22.941458 12162 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:22.946663 12162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea: Generated new TSK 0
I20260806 16:57:22.947585 12162 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:22.984310 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34385
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:23.118052 12175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:23.118422 12175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:23.118477 12175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:23.122946 12175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:23.123029 12175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:23.123100 12175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:23.128854 12175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:23.130034 12175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:23.131090 12175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:23.141902 12181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:23.141906 12180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:23.141901 12183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:23.142077 12175 server_base.cc:1034] running on GCE node
I20260806 16:57:23.142843 12175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:23.143644 12175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:23.144892 12175 hybrid_clock.cc:648] HybridClock initialized: now 1786035443144867 us; error 35 us; skew 500 ppm
Aug 06 16:57:23 dist-test-slave-cbsf krb5kdc[12063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035443, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:23.148092 12175 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:23.149109 12175 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:23.149219 12175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:23.149479 12175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:23.151829 12175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "a87310dd055d49249864e7856bb1f13b"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "239e080416553ee2da0f88a78e6e2ee9"
server_key_iv: "53c80499b8a2a51d47ec3d2338de58e1"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.152499 12175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "a87310dd055d49249864e7856bb1f13b"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "239e080416553ee2da0f88a78e6e2ee9"
server_key_iv: "53c80499b8a2a51d47ec3d2338de58e1"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.157037 12175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 16:57:23.159992 12189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.161777 12175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 16:57:23.161948 12175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "a87310dd055d49249864e7856bb1f13b"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "239e080416553ee2da0f88a78e6e2ee9"
server_key_iv: "53c80499b8a2a51d47ec3d2338de58e1"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.162089 12175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:23.182857 12175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:23.186342 12175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:23.186589 12175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:23.187238 12175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:23.188174 12175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:23.188247 12175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.188330 12175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:23.188375 12175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.198730 12175 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:41345
I20260806 16:57:23.198767 12310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:41345 every 8 connection(s)
I20260806 16:57:23.199420 12175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:23.203569 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12175
I20260806 16:57:23.203743 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:23.204038 7780 external_mini_cluster.cc:1428] Setting key 09b4222e3c7f14c8f025a28da44404c3
Aug 06 16:57:23 dist-test-slave-cbsf krb5kdc[12063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035443, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:57:23.215816 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.201547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:51933 (local address 127.7.153.62:34385)
0806 16:57:23.201744 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.201749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.203083 (+ 1334us) server_negotiation.cc:407] Connection header received
0806 16:57:23.204211 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.204215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.204283 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.204379 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:23.206060 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.206668 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.208024 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.208291 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.208422 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.211541 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:23.211548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:23.211553 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:23.211592 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:23.213366 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.214012 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.214016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.214017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.214101 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.214486 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.214490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.214492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.214717 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:23.214833 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.215463 (+ 630us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.215613 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 16:57:23.216917 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.201960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34385 (local address 127.7.153.1:51933)
0806 16:57:23.202899 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.202948 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.203955 (+ 1007us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.204586 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.204594 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.205205 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:23.205880 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.205897 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.206827 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.206838 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.207866 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.207877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.208479 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.208484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.208714 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.209485 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:23.209505 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:23.211312 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:23.213522 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:23.213530 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:23.213555 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:23.213879 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:23.214207 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:23.214211 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:23.214213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:23.214384 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:23.214833 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:23.214842 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:23.215192 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.215421 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.215815 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":132,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:23.218327 12311 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34385
I20260806 16:57:23.218605 12311 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:23.219112 12311 heartbeater.cc:511] Master 127.7.153.62:34385 requested a full tablet report, sending...
I20260806 16:57:23.220813 12111 ts_manager.cc:194] Registered new tserver with Master: a87310dd055d49249864e7856bb1f13b (127.7.153.1:41345)
I20260806 16:57:23.222018 12111 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:51933
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:23.236133 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34385
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:23.366979 12318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:23.367313 12318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:23.367367 12318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:23.371618 12318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:23.371711 12318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:23.371781 12318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:23.377566 12318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:23.378768 12318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:23.379848 12318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:23.390393 12324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:23.390662 12318 server_base.cc:1034] running on GCE node
W20260806 16:57:23.390395 12323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:23.390393 12327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:23.391315 12318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:23.392011 12318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:23.393184 12318 hybrid_clock.cc:648] HybridClock initialized: now 1786035443393164 us; error 34 us; skew 500 ppm
Aug 06 16:57:23 dist-test-slave-cbsf krb5kdc[12063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035443, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:23.396363 12318 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:23.397353 12318 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:23.397464 12318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:23.397727 12318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:23.400041 12318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "bdcd54a7293949758b475c06aaae1896"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "6e144c3fd549e490169f49eef352e5d9"
server_key_iv: "df26daef13af70f0e5e8cfa84fffd691"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.400679 12318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "bdcd54a7293949758b475c06aaae1896"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "6e144c3fd549e490169f49eef352e5d9"
server_key_iv: "df26daef13af70f0e5e8cfa84fffd691"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.405192 12318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:57:23.408179 12334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.409754 12318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:23.409921 12318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "bdcd54a7293949758b475c06aaae1896"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "6e144c3fd549e490169f49eef352e5d9"
server_key_iv: "df26daef13af70f0e5e8cfa84fffd691"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.410090 12318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:23.428304 12318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:23.431754 12318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:23.431998 12318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:23.432730 12318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:23.433827 12318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:23.433903 12318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.433980 12318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:23.434032 12318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.443837 12318 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:42127
I20260806 16:57:23.443872 12455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:42127 every 8 connection(s)
I20260806 16:57:23.444522 12318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:23.445092 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12318
I20260806 16:57:23.445214 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:23.445545 7780 external_mini_cluster.cc:1428] Setting key 443e6615ff63ceba3cb563c4d978cff3
Aug 06 16:57:23 dist-test-slave-cbsf krb5kdc[12063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035443, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:23.462853 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.446599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:34901 (local address 127.7.153.62:34385)
0806 16:57:23.446768 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.446773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.448552 (+ 1779us) server_negotiation.cc:407] Connection header received
0806 16:57:23.450044 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.450049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.450119 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.450225 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:23.451870 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.452802 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.454369 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.454840 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.454990 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.458140 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:23.458144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:23.458146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:23.458177 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:23.459922 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.460723 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.460728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.460730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.460853 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.461302 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.461308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.461312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.461640 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:23.461758 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.462413 (+ 655us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.462607 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 16:57:23.464188 12458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.447200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34385 (local address 127.7.153.2:34901)
0806 16:57:23.448331 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.448405 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.449723 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.450524 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.450533 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.450982 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:23.451656 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.451673 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.452986 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.452989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.454182 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.454200 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.455068 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.455071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.455281 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.456044 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:23.456065 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:23.457889 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:23.460112 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:23.460128 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:23.460153 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:23.460542 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:23.461001 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:23.461004 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:23.461005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:23.461189 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:23.461808 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:23.461815 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:23.462130 (+ 315us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.462327 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.462735 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":136,"threads_started":1}
I20260806 16:57:23.465790 12456 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34385
I20260806 16:57:23.466146 12456 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:23.466796 12456 heartbeater.cc:511] Master 127.7.153.62:34385 requested a full tablet report, sending...
I20260806 16:57:23.468212 12111 ts_manager.cc:194] Registered new tserver with Master: bdcd54a7293949758b475c06aaae1896 (127.7.153.2:42127)
I20260806 16:57:23.469004 12111 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:34901
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:23.481165 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34385
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:23.605085 12461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:23.605392 12461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:23.605443 12461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:23.609688 12461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:23.609760 12461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:23.609826 12461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:23.615841 12461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:23.617079 12461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:23.618180 12461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:23.628755 12470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:23.628782 12467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:23.628749 12468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:23.628988 12461 server_base.cc:1034] running on GCE node
I20260806 16:57:23.629575 12461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:23.630301 12461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:23.631490 12461 hybrid_clock.cc:648] HybridClock initialized: now 1786035443631469 us; error 30 us; skew 500 ppm
Aug 06 16:57:23 dist-test-slave-cbsf krb5kdc[12063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035443, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:23.635697 12461 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:23.636760 12461 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:23.636876 12461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:23.637122 12461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:23.639511 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "f4f2b2e309cc4dd99c78e361cf11d263"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "16d68f41e3d64d592c5e744e0c53a4d9"
server_key_iv: "7b348acb8d0b30fb1b9982544224c5d0"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.640146 12461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "f4f2b2e309cc4dd99c78e361cf11d263"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "16d68f41e3d64d592c5e744e0c53a4d9"
server_key_iv: "7b348acb8d0b30fb1b9982544224c5d0"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.644434 12461 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:23.647476 12477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.648986 12461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:23.649147 12461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "f4f2b2e309cc4dd99c78e361cf11d263"
format_stamp: "Formatted at 2026-08-06 16:57:23 on dist-test-slave-cbsf"
server_key: "16d68f41e3d64d592c5e744e0c53a4d9"
server_key_iv: "7b348acb8d0b30fb1b9982544224c5d0"
server_key_version: "encryptionkey@0"
I20260806 16:57:23.649282 12461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:23.668009 12461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:23.671490 12461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:23.671754 12461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:23.672454 12461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:23.673484 12461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:23.673563 12461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.673669 12461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:23.673718 12461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:23.683784 12461 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:42509
I20260806 16:57:23.683801 12601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:42509 every 8 connection(s)
I20260806 16:57:23.684477 12461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:23.690358 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12461
I20260806 16:57:23.690474 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:23.690846 7780 external_mini_cluster.cc:1428] Setting key 3cfca56bc9fc677306745e6426798ef3
Aug 06 16:57:23 dist-test-slave-cbsf krb5kdc[12063](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035443, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:23.700397 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.686505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:56987 (local address 127.7.153.62:34385)
0806 16:57:23.686653 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.686656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.687940 (+ 1284us) server_negotiation.cc:407] Connection header received
0806 16:57:23.688977 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.688980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.689044 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.689164 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:23.690610 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.691370 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.692809 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.693067 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.693185 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.696135 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:23.696139 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:23.696141 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:23.696170 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:23.697800 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.698503 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.698506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.698507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.698594 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.699192 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.699195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.699196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.699420 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:23.699538 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.700126 (+ 588us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.700266 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 16:57:23.701361 12604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.686837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34385 (local address 127.7.153.3:56987)
0806 16:57:23.687762 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.687807 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.688675 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.689366 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.689374 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.689832 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:23.690370 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.690384 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.691528 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.691532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.692629 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.692641 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.693265 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.693270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.693474 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.694176 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:23.694194 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:23.695905 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:23.697978 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:23.697985 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:23.698004 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:23.698387 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:23.698800 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:23.698802 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:23.698804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:23.699069 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:23.699550 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:23.699557 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:23.699862 (+ 305us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.700042 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.700350 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":121,"threads_started":1}
I20260806 16:57:23.702721 12602 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34385
I20260806 16:57:23.703003 12602 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:23.703588 12602 heartbeater.cc:511] Master 127.7.153.62:34385 requested a full tablet report, sending...
I20260806 16:57:23.705045 12111 ts_manager.cc:194] Registered new tserver with Master: f4f2b2e309cc4dd99c78e361cf11d263 (127.7.153.3:42509)
I20260806 16:57:23.705678 12111 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:56987
I20260806 16:57:23.717530 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:57:23.727603 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.719659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41066 (local address 127.7.153.62:34385)
0806 16:57:23.719806 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.719810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.719998 (+ 188us) server_negotiation.cc:407] Connection header received
0806 16:57:23.720109 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.720112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.720160 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.720239 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:23.721015 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.721559 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.722542 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.722771 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.722878 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.724389 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:23.724393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:23.724395 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:23.724425 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:23.725914 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.726376 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.726379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.726380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.726466 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:23.726705 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:23.726708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:23.726709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:23.726988 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:23.727108 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.727336 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.727448 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 16:57:23.731032 12111 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:23.734591 12111 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:23.751243 12614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.745021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57324 (local address 127.7.153.3:42509)
0806 16:57:23.746061 (+ 1040us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.746075 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.746101 (+ 26us) server_negotiation.cc:407] Connection header received
0806 16:57:23.746188 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.746193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.746369 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.746550 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:23.746809 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.748003 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.749553 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.750407 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.750530 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.750725 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.750951 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.751059 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":932,"thread_start_us":204,"threads_started":1}
I20260806 16:57:23.751260 12613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.744766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42127 (local address 127.0.0.1:43670)
0806 16:57:23.745287 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.745348 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.745486 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.746178 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.746184 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.746210 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:23.746379 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.746389 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.748141 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.748145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.749681 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.749693 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.750758 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.750762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.750851 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.750905 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.750957 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.751037 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":134,"thread_start_us":89,"threads_started":1}
I20260806 16:57:23.751260 12617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.744766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:42509 (local address 127.0.0.1:57324)
0806 16:57:23.745791 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.745808 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.745903 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.746548 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.746552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.746573 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:23.746679 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.746685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.748146 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.748149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.749417 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.749428 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.750571 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.750578 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.750722 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.750764 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.750896 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.751030 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"mutex_wait_us":699,"thread_start_us":98,"threads_started":1}
I20260806 16:57:23.751578 12615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.745207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43670 (local address 127.7.153.2:42127)
0806 16:57:23.745637 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.745653 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.745680 (+ 27us) server_negotiation.cc:407] Connection header received
0806 16:57:23.745761 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.745766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.745989 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.746546 (+ 557us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:23.746714 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.747974 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.749828 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.750615 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.751134 (+ 519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.751282 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.751336 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.751438 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":110,"threads_started":1}
I20260806 16:57:23.751698 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.745734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:41345 (local address 127.0.0.1:59790)
0806 16:57:23.746102 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.746115 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.746198 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.746937 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.746940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.746957 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:23.747036 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.747042 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.748048 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.748051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.749759 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.749769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.750613 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.750616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.751345 (+ 729us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.751373 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.751457 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.751531 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":895,"thread_start_us":92,"threads_started":1}
I20260806 16:57:23.755118 12526 tablet_service.cc:1467] Processing CreateTablet for tablet 0192d03bb0224fb09275581db906dc78 (DEFAULT_TABLE table=test-table [id=a46c58eb8b944b09a0b0d617010972ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:23.755118 12386 tablet_service.cc:1467] Processing CreateTablet for tablet 0192d03bb0224fb09275581db906dc78 (DEFAULT_TABLE table=test-table [id=a46c58eb8b944b09a0b0d617010972ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:23.756328 12619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.746178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59790 (local address 127.7.153.1:41345)
0806 16:57:23.746508 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.746516 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.746537 (+ 21us) server_negotiation.cc:407] Connection header received
0806 16:57:23.746605 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.746610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.746804 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.746959 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:23.747160 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.747882 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.749860 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.750452 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.750702 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.750854 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.752534 (+ 1680us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.756133 (+ 3599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":161,"threads_started":1}
I20260806 16:57:23.756459 12526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0192d03bb0224fb09275581db906dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:23.756456 12386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0192d03bb0224fb09275581db906dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:23.759577 12241 tablet_service.cc:1467] Processing CreateTablet for tablet 0192d03bb0224fb09275581db906dc78 (DEFAULT_TABLE table=test-table [id=a46c58eb8b944b09a0b0d617010972ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:23.760912 12241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0192d03bb0224fb09275581db906dc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:23.764804 12620 tablet_bootstrap.cc:492] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Bootstrap starting.
I20260806 16:57:23.766673 12621 tablet_bootstrap.cc:492] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Bootstrap starting.
I20260806 16:57:23.767807 12620 tablet_bootstrap.cc:654] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:23.769179 12621 tablet_bootstrap.cc:654] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:23.769497 12622 tablet_bootstrap.cc:492] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: Bootstrap starting.
I20260806 16:57:23.769886 12620 log.cc:824] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:23.770362 12621 log.cc:824] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:23.771916 12622 tablet_bootstrap.cc:654] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:23.772208 12620 tablet_bootstrap.cc:492] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: No bootstrap required, opened a new log
I20260806 16:57:23.772367 12621 tablet_bootstrap.cc:492] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: No bootstrap required, opened a new log
I20260806 16:57:23.772446 12620 ts_tablet_manager.cc:1397] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 16:57:23.772534 12621 ts_tablet_manager.cc:1397] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 16:57:23.772905 12622 log.cc:824] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:23.774776 12622 tablet_bootstrap.cc:492] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: No bootstrap required, opened a new log
I20260806 16:57:23.775017 12622 ts_tablet_manager.cc:1397] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 16:57:23.776674 12621 raft_consensus.cc:348] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.777045 12621 raft_consensus.cc:374] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:23.777107 12621 raft_consensus.cc:729] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdcd54a7293949758b475c06aaae1896, State: Initialized, Role: FOLLOWER
I20260806 16:57:23.776928 12620 raft_consensus.cc:348] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.777197 12620 raft_consensus.cc:374] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:23.777251 12620 raft_consensus.cc:729] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f2b2e309cc4dd99c78e361cf11d263, State: Initialized, Role: FOLLOWER
I20260806 16:57:23.777822 12621 consensus_queue.cc:260] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.777822 12620 consensus_queue.cc:260] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.778846 12456 heartbeater.cc:503] Master 127.7.153.62:34385 was elected leader, sending a full tablet report...
I20260806 16:57:23.779088 12602 heartbeater.cc:503] Master 127.7.153.62:34385 was elected leader, sending a full tablet report...
I20260806 16:57:23.779201 12620 ts_tablet_manager.cc:1428] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 16:57:23.779201 12621 ts_tablet_manager.cc:1428] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260806 16:57:23.780802 12622 raft_consensus.cc:348] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.781080 12622 raft_consensus.cc:374] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:23.781150 12622 raft_consensus.cc:729] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87310dd055d49249864e7856bb1f13b, State: Initialized, Role: FOLLOWER
I20260806 16:57:23.781666 12622 consensus_queue.cc:260] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.782363 12311 heartbeater.cc:503] Master 127.7.153.62:34385 was elected leader, sending a full tablet report...
I20260806 16:57:23.784014 12622 ts_tablet_manager.cc:1428] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260806 16:57:23.874214 12627 raft_consensus.cc:482] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:23.874496 12627 raft_consensus.cc:504] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.875792 12627 leader_election.cc:288] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdcd54a7293949758b475c06aaae1896 (127.7.153.2:42127), a87310dd055d49249864e7856bb1f13b (127.7.153.1:41345)
I20260806 16:57:23.880125 12604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.876126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:41345 (local address 127.7.153.3:38137)
0806 16:57:23.876284 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.876303 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.876426 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.876777 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.876780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.876799 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:23.876948 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.876955 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.877857 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.877861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.878824 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.878835 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.879606 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.879610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.879764 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.879788 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.879868 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.879947 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":21}
I20260806 16:57:23.880138 12619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.876241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:38137 (local address 127.7.153.1:41345)
0806 16:57:23.876387 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.876393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.876428 (+ 35us) server_negotiation.cc:407] Connection header received
0806 16:57:23.876565 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.876568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.876623 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.876744 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:23.877068 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.877736 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.878965 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.879466 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.879551 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.879608 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.879906 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.880007 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 16:57:23.880255 12615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.876372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:44443 (local address 127.7.153.2:42127)
0806 16:57:23.876502 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.876508 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.876866 (+ 358us) server_negotiation.cc:407] Connection header received
0806 16:57:23.876970 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.876974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.877038 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.877120 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:23.877408 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.878002 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.879166 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.879631 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.879742 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.879809 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.880028 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.880111 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:23.880290 12629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.876139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42127 (local address 127.7.153.3:44443)
0806 16:57:23.876760 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.876776 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:23.876888 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:23.877147 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:23.877151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:23.877181 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:23.877293 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.877300 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.878136 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.878138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.879025 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:23.879035 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.879756 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.879759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:23.879885 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.879912 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:57:23.879989 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 16:57:23.880055 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":195,"thread_start_us":139,"threads_started":1}
I20260806 16:57:23.880957 12263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0192d03bb0224fb09275581db906dc78" candidate_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87310dd055d49249864e7856bb1f13b" is_pre_election: true
I20260806 16:57:23.880985 12408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0192d03bb0224fb09275581db906dc78" candidate_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdcd54a7293949758b475c06aaae1896" is_pre_election: true
I20260806 16:57:23.881302 12408 raft_consensus.cc:2454] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4f2b2e309cc4dd99c78e361cf11d263 in term 0.
I20260806 16:57:23.881311 12263 raft_consensus.cc:2454] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4f2b2e309cc4dd99c78e361cf11d263 in term 0.
I20260806 16:57:23.881882 12479 leader_election.cc:302] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdcd54a7293949758b475c06aaae1896, f4f2b2e309cc4dd99c78e361cf11d263; no voters:
I20260806 16:57:23.882205 12627 raft_consensus.cc:2781] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:23.882296 12627 raft_consensus.cc:482] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:23.882341 12627 raft_consensus.cc:3037] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:23.883510 12627 raft_consensus.cc:504] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.883947 12627 leader_election.cc:288] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [CANDIDATE]: Term 1 election: Requested vote from peers bdcd54a7293949758b475c06aaae1896 (127.7.153.2:42127), a87310dd055d49249864e7856bb1f13b (127.7.153.1:41345)
I20260806 16:57:23.884377 12408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0192d03bb0224fb09275581db906dc78" candidate_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdcd54a7293949758b475c06aaae1896"
I20260806 16:57:23.884510 12408 raft_consensus.cc:3037] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:23.885691 12408 raft_consensus.cc:2454] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f2b2e309cc4dd99c78e361cf11d263 in term 1.
I20260806 16:57:23.886077 12479 leader_election.cc:302] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdcd54a7293949758b475c06aaae1896, f4f2b2e309cc4dd99c78e361cf11d263; no voters:
I20260806 16:57:23.886279 12627 raft_consensus.cc:2781] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:23.886413 12263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0192d03bb0224fb09275581db906dc78" candidate_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87310dd055d49249864e7856bb1f13b"
I20260806 16:57:23.886548 12627 raft_consensus.cc:686] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 1 LEADER]: Becoming Leader. State: Replica: f4f2b2e309cc4dd99c78e361cf11d263, State: Running, Role: LEADER
I20260806 16:57:23.886566 12263 raft_consensus.cc:3037] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:23.886919 12627 consensus_queue.cc:237] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } }
I20260806 16:57:23.887997 12263 raft_consensus.cc:2454] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4f2b2e309cc4dd99c78e361cf11d263 in term 1.
I20260806 16:57:23.890245 12108 catalog_manager.cc:5495] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4f2b2e309cc4dd99c78e361cf11d263 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4f2b2e309cc4dd99c78e361cf11d263" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:23.908979 12614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.904324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57340 (local address 127.7.153.3:42509)
0806 16:57:23.904456 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:23.904460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:23.904473 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:23.904554 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:23.904557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:23.904617 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:23.904780 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:23.905465 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.905987 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.906975 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:23.907264 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:23.907508 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:23.907912 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:23.908391 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:23.908490 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:23.908586 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 16:57:23.908669 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 16:57:23.915760 12263 raft_consensus.cc:1261] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 1 FOLLOWER]: Refusing update from remote peer f4f2b2e309cc4dd99c78e361cf11d263: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:23.915760 12408 raft_consensus.cc:1261] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 1 FOLLOWER]: Refusing update from remote peer f4f2b2e309cc4dd99c78e361cf11d263: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:23.916749 12630 consensus_queue.cc:1035] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdcd54a7293949758b475c06aaae1896" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:23.917008 12627 consensus_queue.cc:1035] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87310dd055d49249864e7856bb1f13b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:23.926571 12635 mvcc.cc:205] Tried to move back new op lower bound from 7315601178270609408 to 7315601178164051968. Current Snapshot: MvccSnapshot[applied={T|T < 7315601178270609408}]
I20260806 16:57:23.928622 12634 mvcc.cc:205] Tried to move back new op lower bound from 7315601178270609408 to 7315601178164051968. Current Snapshot: MvccSnapshot[applied={T|T < 7315601178270609408}]
I20260806 16:57:23.934122 12109 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:23.934320 12109 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:23.937000 12109 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df11e86a1b114f46a2249e708cd01bea: Sending DeleteTablet for 3 replicas of tablet 0192d03bb0224fb09275581db906dc78
I20260806 16:57:23.937996 12526 tablet_service.cc:1514] Processing DeleteTablet for tablet 0192d03bb0224fb09275581db906dc78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:23 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:57324
I20260806 16:57:23.937963 12386 tablet_service.cc:1514] Processing DeleteTablet for tablet 0192d03bb0224fb09275581db906dc78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:23 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43670
I20260806 16:57:23.938033 12241 tablet_service.cc:1514] Processing DeleteTablet for tablet 0192d03bb0224fb09275581db906dc78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:23 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:59790
I20260806 16:57:23.938581 12642 tablet_replica.cc:330] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: stopping tablet replica
I20260806 16:57:23.938953 12642 raft_consensus.cc:2229] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:23.939080 12644 tablet_replica.cc:330] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b: stopping tablet replica
I20260806 16:57:23.939420 12644 raft_consensus.cc:2229] T 0192d03bb0224fb09275581db906dc78 P a87310dd055d49249864e7856bb1f13b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:23.939466 12642 raft_consensus.cc:2258] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:23.939610 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12175
I20260806 16:57:23.940259 12643 tablet_replica.cc:330] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: stopping tablet replica
I20260806 16:57:23.940557 12643 raft_consensus.cc:2229] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:23.941155 12643 raft_consensus.cc:2258] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:23.942556 12642 ts_tablet_manager.cc:1905] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:23.942741 12643 ts_tablet_manager.cc:1905] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:23.945534 12642 ts_tablet_manager.cc:1918] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:23.945566 12643 ts_tablet_manager.cc:1918] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:23.945674 12643 log.cc:1196] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/0192d03bb0224fb09275581db906dc78
I20260806 16:57:23.945746 12642 log.cc:1196] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/0192d03bb0224fb09275581db906dc78
I20260806 16:57:23.946067 12643 ts_tablet_manager.cc:1939] T 0192d03bb0224fb09275581db906dc78 P bdcd54a7293949758b475c06aaae1896: Deleting consensus metadata
I20260806 16:57:23.946067 12642 ts_tablet_manager.cc:1939] T 0192d03bb0224fb09275581db906dc78 P f4f2b2e309cc4dd99c78e361cf11d263: Deleting consensus metadata
I20260806 16:57:23.947441 12097 catalog_manager.cc:4841] TS f4f2b2e309cc4dd99c78e361cf11d263 (127.7.153.3:42509): tablet 0192d03bb0224fb09275581db906dc78 (table test-table [id=a46c58eb8b944b09a0b0d617010972ba]) successfully deleted
I20260806 16:57:23.947753 12094 catalog_manager.cc:4841] TS bdcd54a7293949758b475c06aaae1896 (127.7.153.2:42127): tablet 0192d03bb0224fb09275581db906dc78 (table test-table [id=a46c58eb8b944b09a0b0d617010972ba]) successfully deleted
W20260806 16:57:23.951170 12097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:41345 (error 108)
I20260806 16:57:23.951409 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12318
I20260806 16:57:23.953451 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:23.952769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:41345 (local address 127.0.0.1:59804)
0806 16:57:23.953250 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:23.953352 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:41345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375}
W20260806 16:57:23.953843 12097 catalog_manager.cc:4584] TS a87310dd055d49249864e7856bb1f13b (127.7.153.1:41345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0192d03bb0224fb09275581db906dc78: Network error: Client connection negotiation failed: client connection to 127.7.153.1:41345: connect: Connection refused (error 111)
I20260806 16:57:23.959969 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12461
I20260806 16:57:23.969604 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12077
2026-08-06T16:57:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2511 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T16:57:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:23Z Disabled control of system clock
I20260806 16:57:24.006621 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42113
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:41213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 16:57:24.129657 12649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:24.129992 12649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:24.130033 12649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:24.134447 12649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:24.134531 12649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:24.134547 12649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:24.134567 12649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:24.134584 12649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:24.139989 12649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:41213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42113
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:24.141467 12649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:24.142969 12649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:24.152382 12657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:24.152437 12655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.152531 12649 server_base.cc:1034] running on GCE node
W20260806 16:57:24.152755 12654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.153447 12649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:24.154753 12649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:24.155973 12649 hybrid_clock.cc:648] HybridClock initialized: now 1786035444155953 us; error 38 us; skew 500 ppm
I20260806 16:57:24.158350 12649 webserver.cc:460] Webserver started at http://127.7.153.62:33519/ using document root <none> and password file <none>
I20260806 16:57:24.159044 12649 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:24.159148 12649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:24.159482 12649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:24.161895 12649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "0f72796c459049a7924d669e804a89a0"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "2c624a686804189e6ca27d64be3ce539"
server_key_iv: "e976ded2055088a087d17780c2581efd"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.162559 12649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "0f72796c459049a7924d669e804a89a0"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "2c624a686804189e6ca27d64be3ce539"
server_key_iv: "e976ded2055088a087d17780c2581efd"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.166819 12649 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:24.169629 12663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.171020 12649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:24.171182 12649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "0f72796c459049a7924d669e804a89a0"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "2c624a686804189e6ca27d64be3ce539"
server_key_iv: "e976ded2055088a087d17780c2581efd"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.171319 12649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:24.176465 12649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:24.177250 12649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:24.177451 12649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:24.184801 12649 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42113
I20260806 16:57:24.184809 12719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42113 every 8 connection(s)
I20260806 16:57:24.185873 12649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:24.189483 12720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:24.194753 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12649
I20260806 16:57:24.194892 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:24.195218 7780 external_mini_cluster.cc:1428] Setting key 06486042422e32b44688574e9416cf13
I20260806 16:57:24.196074 12720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0: Bootstrap starting.
I20260806 16:57:24.198681 12720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:24.199687 12720 log.cc:824] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:24.201635 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.196839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55416 (local address 127.7.153.62:42113)
0806 16:57:24.197556 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.197574 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.197618 (+ 44us) server_negotiation.cc:407] Connection header received
0806 16:57:24.198318 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.198337 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.198730 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.199109 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.200187 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.200192 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.200205 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.200216 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.200277 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.200294 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.200444 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.200578 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.200896 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":169,"threads_started":1}
I20260806 16:57:24.202015 12720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0: No bootstrap required, opened a new log
I20260806 16:57:24.206655 12720 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f72796c459049a7924d669e804a89a0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42113 } }
I20260806 16:57:24.206956 12720 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:24.207053 12720 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f72796c459049a7924d669e804a89a0, State: Initialized, Role: FOLLOWER
I20260806 16:57:24.207516 12720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f72796c459049a7924d669e804a89a0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42113 } }
I20260806 16:57:24.207683 12720 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:24.207772 12720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:24.207901 12720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:24.209147 12720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f72796c459049a7924d669e804a89a0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42113 } }
I20260806 16:57:24.209585 12720 leader_election.cc:302] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f72796c459049a7924d669e804a89a0; no voters:
I20260806 16:57:24.210059 12720 leader_election.cc:288] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:24.210142 12726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:24.210608 12726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [term 1 LEADER]: Becoming Leader. State: Replica: 0f72796c459049a7924d669e804a89a0, State: Running, Role: LEADER
I20260806 16:57:24.210937 12726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f72796c459049a7924d669e804a89a0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42113 } }
I20260806 16:57:24.211607 12720 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:24.213099 12727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f72796c459049a7924d669e804a89a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f72796c459049a7924d669e804a89a0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42113 } } }
I20260806 16:57:24.213122 12728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f72796c459049a7924d669e804a89a0. Latest consensus state: current_term: 1 leader_uuid: "0f72796c459049a7924d669e804a89a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f72796c459049a7924d669e804a89a0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42113 } } }
I20260806 16:57:24.213286 12728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:24.213287 12727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:24.214924 12735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:24.218062 12735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:24.225210 12735 catalog_manager.cc:1347] Generated new cluster ID: c6ff96a618954ec1bc97e58035d4ebeb
I20260806 16:57:24.225332 12735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:24.234473 12735 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:24.234908 12735 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:24.244519 12735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0: Generated new TSK 0
I20260806 16:57:24.245528 12735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:57:24.250375 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42113
--builtin_ntp_servers=127.7.153.20:41213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 16:57:24.384891 12745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:24.385226 12745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:24.385270 12745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:24.389649 12745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:24.389729 12745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:24.389791 12745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:24.394961 12745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:41213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:24.396238 12745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:24.397806 12745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:24.408567 12751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:24.408645 12752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:24.408550 12754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.409118 12745 server_base.cc:1034] running on GCE node
I20260806 16:57:24.409570 12745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:24.410302 12745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:24.411506 12745 hybrid_clock.cc:648] HybridClock initialized: now 1786035444411493 us; error 34 us; skew 500 ppm
I20260806 16:57:24.413887 12745 webserver.cc:460] Webserver started at http://127.7.153.1:33771/ using document root <none> and password file <none>
I20260806 16:57:24.414531 12745 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:24.414628 12745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:24.414876 12745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:24.417253 12745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "3dda5cfaaae54a3f91ba4db0539b9e04"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "18e2460ecb3550e378764660d6e983a9"
server_key_iv: "32dafdabafb2a1654a7a8b2451029cd1"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.417886 12745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "3dda5cfaaae54a3f91ba4db0539b9e04"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "18e2460ecb3550e378764660d6e983a9"
server_key_iv: "32dafdabafb2a1654a7a8b2451029cd1"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.422142 12745 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:24.425108 12760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.426579 12745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:24.426759 12745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "3dda5cfaaae54a3f91ba4db0539b9e04"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "18e2460ecb3550e378764660d6e983a9"
server_key_iv: "32dafdabafb2a1654a7a8b2451029cd1"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.426904 12745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:24.432133 12745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:24.432957 12745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:24.433167 12745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:24.433805 12745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:24.435078 12745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:24.435228 12745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.435320 12745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:24.435451 12745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.446171 12745 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:37947
I20260806 16:57:24.446194 12880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:37947 every 8 connection(s)
I20260806 16:57:24.447238 12745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:24.449920 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12745
I20260806 16:57:24.450080 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:24.450434 7780 external_mini_cluster.cc:1428] Setting key 32c86c24e11f7ac9525c6c4afcc3a983
I20260806 16:57:24.453413 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42113
--builtin_ntp_servers=127.7.153.20:41213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 16:57:24.455735 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.449447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:46407 (local address 127.7.153.62:42113)
0806 16:57:24.449668 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.449675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.450978 (+ 1303us) server_negotiation.cc:407] Connection header received
0806 16:57:24.452554 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.452560 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.452638 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.452911 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.455066 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.455073 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.455080 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.455105 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.455149 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.455165 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.455294 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.455464 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.455528 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 16:57:24.457191 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.449877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42113 (local address 127.7.153.1:46407)
0806 16:57:24.450772 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.450831 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.452206 (+ 1375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.453365 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.453375 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.453497 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.454537 (+ 1040us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.454540 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.454611 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.454730 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.455287 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.455299 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.455304 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.455489 (+ 185us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.455908 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":223,"threads_started":1}
I20260806 16:57:24.458863 12881 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42113
I20260806 16:57:24.459189 12881 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:24.459728 12881 heartbeater.cc:511] Master 127.7.153.62:42113 requested a full tablet report, sending...
I20260806 16:57:24.461627 12683 ts_manager.cc:194] Registered new tserver with Master: 3dda5cfaaae54a3f91ba4db0539b9e04 (127.7.153.1:37947)
W20260806 16:57:24.580488 12884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:24.580922 12884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:24.581007 12884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:24.585355 12884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:24.585462 12884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:24.585569 12884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:24.590687 12884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:41213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:24.591929 12884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:24.593472 12884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:24.604010 12890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:24.604007 12889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.604226 12884 server_base.cc:1034] running on GCE node
W20260806 16:57:24.604640 12892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.605230 12884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:24.605984 12884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:24.607189 12884 hybrid_clock.cc:648] HybridClock initialized: now 1786035444607174 us; error 31 us; skew 500 ppm
I20260806 16:57:24.609519 12884 webserver.cc:460] Webserver started at http://127.7.153.2:46745/ using document root <none> and password file <none>
I20260806 16:57:24.610217 12884 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:24.610324 12884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:24.610581 12884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:24.613379 12884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "a12f8d1224e94e4ca2995b04f0266193"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "37383016bdadd18d68b47bbf3319321f"
server_key_iv: "b721b50094a1f2b9b9d8fa587c1efd0f"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.614035 12884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "a12f8d1224e94e4ca2995b04f0266193"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "37383016bdadd18d68b47bbf3319321f"
server_key_iv: "b721b50094a1f2b9b9d8fa587c1efd0f"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.618818 12884 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:24.621598 12899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.622977 12884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:24.623152 12884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "a12f8d1224e94e4ca2995b04f0266193"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "37383016bdadd18d68b47bbf3319321f"
server_key_iv: "b721b50094a1f2b9b9d8fa587c1efd0f"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.623291 12884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:24.628425 12884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:24.629249 12884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:24.629463 12884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:24.630091 12884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:24.631239 12884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:24.631313 12884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.631383 12884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:24.631431 12884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.640811 12884 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:37173
I20260806 16:57:24.640846 13018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:37173 every 8 connection(s)
I20260806 16:57:24.641880 12884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:24.643277 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 12884
I20260806 16:57:24.643414 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:24.643702 7780 external_mini_cluster.cc:1428] Setting key 1d121a3c9787fba7429e519519331835
I20260806 16:57:24.645995 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42113
--builtin_ntp_servers=127.7.153.20:41213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 16:57:24.649240 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.644132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:43509 (local address 127.7.153.62:42113)
0806 16:57:24.644326 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.644331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.645751 (+ 1420us) server_negotiation.cc:407] Connection header received
0806 16:57:24.647275 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.647281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.647336 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.647436 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.648744 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.648750 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.648754 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.648772 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.648797 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.648809 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.648922 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.649012 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.649065 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 16:57:24.650193 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.644660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42113 (local address 127.7.153.2:43509)
0806 16:57:24.645559 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.645629 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.647040 (+ 1411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.647634 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.647642 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.647738 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.648396 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.648398 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.648449 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.648526 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.648900 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.648905 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.648909 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.649049 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.649263 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":208,"threads_started":1}
I20260806 16:57:24.651540 13019 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42113
I20260806 16:57:24.651816 13019 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:24.652282 13019 heartbeater.cc:511] Master 127.7.153.62:42113 requested a full tablet report, sending...
I20260806 16:57:24.653499 12683 ts_manager.cc:194] Registered new tserver with Master: a12f8d1224e94e4ca2995b04f0266193 (127.7.153.2:37173)
W20260806 16:57:24.770931 13022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:24.771284 13022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:24.771369 13022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:24.775874 13022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:24.775969 13022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:24.776098 13022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:24.781314 13022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:41213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:24.782614 13022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:24.784189 13022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:24.794516 13027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.794589 13022 server_base.cc:1034] running on GCE node
W20260806 16:57:24.794536 13028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:24.794564 13031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:24.795239 13022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:24.796007 13022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:24.797240 13022 hybrid_clock.cc:648] HybridClock initialized: now 1786035444797217 us; error 34 us; skew 500 ppm
I20260806 16:57:24.799466 13022 webserver.cc:460] Webserver started at http://127.7.153.3:46001/ using document root <none> and password file <none>
I20260806 16:57:24.800278 13022 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:24.800392 13022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:24.800748 13022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:24.803128 13022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "400753b2411048a49e2c1d508ee31e49"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "2606a79232c3c5c43e0484c00d40274a"
server_key_iv: "a8b32e79a2df7486662abbad9c8beb3d"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.803818 13022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "400753b2411048a49e2c1d508ee31e49"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "2606a79232c3c5c43e0484c00d40274a"
server_key_iv: "a8b32e79a2df7486662abbad9c8beb3d"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.808426 13022 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:24.811872 13037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.813807 13022 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:57:24.813990 13022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "400753b2411048a49e2c1d508ee31e49"
format_stamp: "Formatted at 2026-08-06 16:57:24 on dist-test-slave-cbsf"
server_key: "2606a79232c3c5c43e0484c00d40274a"
server_key_iv: "a8b32e79a2df7486662abbad9c8beb3d"
server_key_version: "encryptionkey@0"
I20260806 16:57:24.814144 13022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:24.819540 13022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:24.820392 13022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:24.820624 13022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:24.821309 13022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:24.822398 13022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:24.822476 13022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.822542 13022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:24.822603 13022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:24.832530 13022 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:35713
I20260806 16:57:24.832571 13157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:35713 every 8 connection(s)
I20260806 16:57:24.833683 13022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:24.834806 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13022
I20260806 16:57:24.834939 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:24.835265 7780 external_mini_cluster.cc:1428] Setting key 0c2c8db818e9efee142eaeea276a0d60
I20260806 16:57:24.842325 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.836683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:53389 (local address 127.7.153.62:42113)
0806 16:57:24.836864 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.836867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.838330 (+ 1463us) server_negotiation.cc:407] Connection header received
0806 16:57:24.839681 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.839684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.839725 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.839819 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.841647 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.841651 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.841653 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.841667 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.841694 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.841703 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.841813 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.842141 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.842194 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 16:57:24.843554 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.837291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42113 (local address 127.7.153.3:53389)
0806 16:57:24.838170 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.838226 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.839452 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.840043 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.840050 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.840146 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.841062 (+ 916us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.841065 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.841136 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.841364 (+ 228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.841879 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.841891 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.841899 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.842129 (+ 230us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.842388 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":208,"threads_started":1}
I20260806 16:57:24.845005 13158 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42113
I20260806 16:57:24.845278 13158 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:24.845727 13158 heartbeater.cc:511] Master 127.7.153.62:42113 requested a full tablet report, sending...
I20260806 16:57:24.846932 12683 ts_manager.cc:194] Registered new tserver with Master: 400753b2411048a49e2c1d508ee31e49 (127.7.153.3:35713)
I20260806 16:57:24.849670 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:57:24.853305 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.851576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.7.153.62:42113)
0806 16:57:24.851749 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.851752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.851922 (+ 170us) server_negotiation.cc:407] Connection header received
0806 16:57:24.852036 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.852039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.852077 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.852152 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.852958 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.852961 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.852963 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.852975 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.852996 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.853004 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.853088 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.853158 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.853193 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 16:57:24.857576 12683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:24.862154 12683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:24.878229 13170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.874327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35713 (local address 127.0.0.1:55940)
0806 16:57:24.874962 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.875025 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.875688 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.876455 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.876461 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.876540 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.877361 (+ 821us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.877365 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.877390 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.877469 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.877823 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.877834 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.877843 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.877964 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.878044 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":114,"threads_started":1}
I20260806 16:57:24.878310 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.875168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:37173 (local address 127.0.0.1:51498)
0806 16:57:24.876126 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.876137 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.876229 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.877116 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.877119 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.877132 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.877631 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.877632 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.877641 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.877664 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.878042 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.878046 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.878049 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.878121 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.878161 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":105,"threads_started":1}
I20260806 16:57:24.878229 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.874343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37947 (local address 127.0.0.1:49792)
0806 16:57:24.875819 (+ 1476us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.875833 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.875951 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.876873 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.876876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.876891 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.877388 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.877390 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.877405 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.877476 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.877960 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.877963 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.877966 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.878055 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.878081 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1401,"thread_start_us":106,"threads_started":1}
I20260806 16:57:24.878927 13176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.875346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.7.153.2:37173)
0806 16:57:24.875774 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.875786 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.876227 (+ 441us) server_negotiation.cc:407] Connection header received
0806 16:57:24.876320 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.876325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.876524 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.876721 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.877794 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.877802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.877815 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.877826 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.877867 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.877896 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.877994 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.878474 (+ 480us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.878564 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":141,"threads_started":1}
I20260806 16:57:24.879221 13175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.875156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55940 (local address 127.7.153.3:35713)
0806 16:57:24.875968 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.875980 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.876003 (+ 23us) server_negotiation.cc:407] Connection header received
0806 16:57:24.876062 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.876069 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.876289 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.876447 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.877622 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.877635 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.877646 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.877656 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.877697 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.877745 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.877861 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.877977 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.879033 (+ 1056us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":139,"threads_started":1}
I20260806 16:57:24.880081 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.874611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.7.153.1:37947)
0806 16:57:24.875659 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.875673 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.875954 (+ 281us) server_negotiation.cc:407] Connection header received
0806 16:57:24.876142 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.876148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.876288 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.876478 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.877711 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.877719 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.877733 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.877746 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.877785 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.877813 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.877918 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.878283 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.879198 (+ 915us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":904,"thread_start_us":241,"threads_started":1}
I20260806 16:57:24.882577 13088 tablet_service.cc:1467] Processing CreateTablet for tablet 281381b201ff42afad1d35c7105417cb (DEFAULT_TABLE table=test-table [id=4ba4897ba87e4fc794db5ad5efcc44a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:24.882573 12949 tablet_service.cc:1467] Processing CreateTablet for tablet 281381b201ff42afad1d35c7105417cb (DEFAULT_TABLE table=test-table [id=4ba4897ba87e4fc794db5ad5efcc44a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:24.882862 12812 tablet_service.cc:1467] Processing CreateTablet for tablet 281381b201ff42afad1d35c7105417cb (DEFAULT_TABLE table=test-table [id=4ba4897ba87e4fc794db5ad5efcc44a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:24.883880 12949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281381b201ff42afad1d35c7105417cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:24.883880 13088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281381b201ff42afad1d35c7105417cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:24.884037 12812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281381b201ff42afad1d35c7105417cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:24.892426 13179 tablet_bootstrap.cc:492] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Bootstrap starting.
I20260806 16:57:24.893342 13177 tablet_bootstrap.cc:492] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: Bootstrap starting.
I20260806 16:57:24.894846 13179 tablet_bootstrap.cc:654] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:24.895454 13177 tablet_bootstrap.cc:654] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:24.895843 13179 log.cc:824] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:24.896299 13177 log.cc:824] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:24.897200 13178 tablet_bootstrap.cc:492] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Bootstrap starting.
I20260806 16:57:24.898589 13177 tablet_bootstrap.cc:492] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: No bootstrap required, opened a new log
I20260806 16:57:24.898589 13179 tablet_bootstrap.cc:492] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: No bootstrap required, opened a new log
I20260806 16:57:24.898834 13179 ts_tablet_manager.cc:1397] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 16:57:24.898835 13177 ts_tablet_manager.cc:1397] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 16:57:24.899891 13178 tablet_bootstrap.cc:654] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:24.900949 13178 log.cc:824] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:24.903671 13177 raft_consensus.cc:348] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.903966 13177 raft_consensus.cc:374] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:24.904035 13177 raft_consensus.cc:729] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dda5cfaaae54a3f91ba4db0539b9e04, State: Initialized, Role: FOLLOWER
I20260806 16:57:24.903857 13179 raft_consensus.cc:348] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.904420 13179 raft_consensus.cc:374] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:24.904547 13179 raft_consensus.cc:729] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12f8d1224e94e4ca2995b04f0266193, State: Initialized, Role: FOLLOWER
I20260806 16:57:24.904619 13177 consensus_queue.cc:260] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.904798 13178 tablet_bootstrap.cc:492] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: No bootstrap required, opened a new log
I20260806 16:57:24.905099 13178 ts_tablet_manager.cc:1397] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260806 16:57:24.905265 13179 consensus_queue.cc:260] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.906494 13179 ts_tablet_manager.cc:1428] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 16:57:24.906913 13019 heartbeater.cc:503] Master 127.7.153.62:42113 was elected leader, sending a full tablet report...
I20260806 16:57:24.907058 12881 heartbeater.cc:503] Master 127.7.153.62:42113 was elected leader, sending a full tablet report...
I20260806 16:57:24.908102 13177 ts_tablet_manager.cc:1428] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260806 16:57:24.911721 13178 raft_consensus.cc:348] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.912101 13178 raft_consensus.cc:374] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:24.912182 13178 raft_consensus.cc:729] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 400753b2411048a49e2c1d508ee31e49, State: Initialized, Role: FOLLOWER
I20260806 16:57:24.912803 13178 consensus_queue.cc:260] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.914383 13178 ts_tablet_manager.cc:1428] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260806 16:57:24.915014 13158 heartbeater.cc:503] Master 127.7.153.62:42113 was elected leader, sending a full tablet report...
W20260806 16:57:24.948649 12882 tablet.cc:2369] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:24.970911 13183 raft_consensus.cc:482] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:24.971197 13183 raft_consensus.cc:504] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.972612 13183 leader_election.cc:288] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 400753b2411048a49e2c1d508ee31e49 (127.7.153.3:35713), 3dda5cfaaae54a3f91ba4db0539b9e04 (127.7.153.1:37947)
I20260806 16:57:24.975031 13175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.973118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:34481 (local address 127.7.153.3:35713)
0806 16:57:24.973255 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.973261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.973275 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:57:24.973324 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.973327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.973365 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.973465 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.974472 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.974475 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.974478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.974489 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.974510 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.974519 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.974690 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.974838 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.974884 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 16:57:24.975031 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.972869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35713 (local address 127.7.153.2:34481)
0806 16:57:24.973020 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.973038 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.973133 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.973562 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.973567 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.973586 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.974269 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.974271 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.974282 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.974308 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.974720 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.974723 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.974727 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.974840 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.974884 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 16:57:24.975208 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.973117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:52415 (local address 127.7.153.1:37947)
0806 16:57:24.973260 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:24.973266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:24.973525 (+ 259us) server_negotiation.cc:407] Connection header received
0806 16:57:24.973591 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:24.973594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:24.973650 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:24.973774 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:24.974723 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:24.974726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:24.974729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:24.974743 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:24.974765 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:24.974774 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:24.974841 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:24.975034 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 16:57:24.975083 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 16:57:24.975617 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:24.973007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37947 (local address 127.7.153.2:52415)
0806 16:57:24.973402 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:24.973416 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:24.973502 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:24.973883 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:24.973888 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:24.973914 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:24.974503 (+ 589us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:57:24.974504 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:24.974514 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:57:24.974561 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:24.974926 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:24.974929 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:24.974935 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 16:57:24.975417 (+ 482us) client_negotiation.cc:240] Negotiation successful
0806 16:57:24.975459 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":125,"threads_started":1}
I20260806 16:57:24.975932 13110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281381b201ff42afad1d35c7105417cb" candidate_uuid: "a12f8d1224e94e4ca2995b04f0266193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "400753b2411048a49e2c1d508ee31e49" is_pre_election: true
I20260806 16:57:24.976217 12832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281381b201ff42afad1d35c7105417cb" candidate_uuid: "a12f8d1224e94e4ca2995b04f0266193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" is_pre_election: true
I20260806 16:57:24.976293 13110 raft_consensus.cc:2454] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a12f8d1224e94e4ca2995b04f0266193 in term 0.
I20260806 16:57:24.976511 12832 raft_consensus.cc:2454] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a12f8d1224e94e4ca2995b04f0266193 in term 0.
I20260806 16:57:24.976928 12900 leader_election.cc:302] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 400753b2411048a49e2c1d508ee31e49, a12f8d1224e94e4ca2995b04f0266193; no voters:
I20260806 16:57:24.977262 13183 raft_consensus.cc:2781] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:24.977363 13183 raft_consensus.cc:482] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:24.977413 13183 raft_consensus.cc:3037] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:24.978597 13183 raft_consensus.cc:504] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.979015 13183 leader_election.cc:288] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [CANDIDATE]: Term 1 election: Requested vote from peers 400753b2411048a49e2c1d508ee31e49 (127.7.153.3:35713), 3dda5cfaaae54a3f91ba4db0539b9e04 (127.7.153.1:37947)
I20260806 16:57:24.979446 13110 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281381b201ff42afad1d35c7105417cb" candidate_uuid: "a12f8d1224e94e4ca2995b04f0266193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "400753b2411048a49e2c1d508ee31e49"
I20260806 16:57:24.979569 12832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281381b201ff42afad1d35c7105417cb" candidate_uuid: "a12f8d1224e94e4ca2995b04f0266193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04"
I20260806 16:57:24.979606 13110 raft_consensus.cc:3037] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:24.979756 12832 raft_consensus.cc:3037] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:24.980949 13110 raft_consensus.cc:2454] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a12f8d1224e94e4ca2995b04f0266193 in term 1.
I20260806 16:57:24.981128 12832 raft_consensus.cc:2454] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a12f8d1224e94e4ca2995b04f0266193 in term 1.
I20260806 16:57:24.981348 12900 leader_election.cc:302] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 400753b2411048a49e2c1d508ee31e49, a12f8d1224e94e4ca2995b04f0266193; no voters:
I20260806 16:57:24.981580 13183 raft_consensus.cc:2781] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:24.981855 13183 raft_consensus.cc:686] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 1 LEADER]: Becoming Leader. State: Replica: a12f8d1224e94e4ca2995b04f0266193, State: Running, Role: LEADER
I20260806 16:57:24.982302 13183 consensus_queue.cc:237] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } }
I20260806 16:57:24.986043 12683 catalog_manager.cc:5495] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 reported cstate change: term changed from 0 to 1, leader changed from <none> to a12f8d1224e94e4ca2995b04f0266193 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "a12f8d1224e94e4ca2995b04f0266193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a12f8d1224e94e4ca2995b04f0266193" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 37173 } health_report { overall_health: HEALTHY } } }
I20260806 16:57:25.007998 13176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:25.006379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51504 (local address 127.7.153.2:37173)
0806 16:57:25.006516 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:25.006520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:25.006535 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:25.006672 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:25.006674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:25.006739 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:25.006817 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:25.007686 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:25.007688 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:25.007690 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:25.007699 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:25.007715 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:25.007722 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:25.007789 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:25.007852 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 16:57:25.007887 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 16:57:25.015201 12832 raft_consensus.cc:1261] T 281381b201ff42afad1d35c7105417cb P 3dda5cfaaae54a3f91ba4db0539b9e04 [term 1 FOLLOWER]: Refusing update from remote peer a12f8d1224e94e4ca2995b04f0266193: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:25.015450 13110 raft_consensus.cc:1261] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 1 FOLLOWER]: Refusing update from remote peer a12f8d1224e94e4ca2995b04f0266193: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:25.016122 13183 consensus_queue.cc:1035] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dda5cfaaae54a3f91ba4db0539b9e04" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:25.016434 13187 consensus_queue.cc:1035] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "400753b2411048a49e2c1d508ee31e49" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:25.026384 13191 mvcc.cc:205] Tried to move back new op lower bound from 7315601182773325824 to 7315601182650785792. Current Snapshot: MvccSnapshot[applied={T|T < 7315601182773325824}]
I20260806 16:57:25.029863 13192 mvcc.cc:205] Tried to move back new op lower bound from 7315601182773325824 to 7315601182650785792. Current Snapshot: MvccSnapshot[applied={T|T < 7315601182773325824}]
I20260806 16:57:25.036177 12681 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:25.036392 12681 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:25.039465 12681 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f72796c459049a7924d669e804a89a0: Sending DeleteTablet for 3 replicas of tablet 281381b201ff42afad1d35c7105417cb
I20260806 16:57:25.040899 13088 tablet_service.cc:1514] Processing DeleteTablet for tablet 281381b201ff42afad1d35c7105417cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:25 UTC) from {username='slave'} at 127.0.0.1:55940
I20260806 16:57:25.041004 12812 tablet_service.cc:1514] Processing DeleteTablet for tablet 281381b201ff42afad1d35c7105417cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:25 UTC) from {username='slave'} at 127.0.0.1:49792
I20260806 16:57:25.041406 12949 tablet_service.cc:1514] Processing DeleteTablet for tablet 281381b201ff42afad1d35c7105417cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:25 UTC) from {username='slave'} at 127.0.0.1:51498
I20260806 16:57:25.041971 13201 tablet_replica.cc:330] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: stopping tablet replica
I20260806 16:57:25.042155 13203 tablet_replica.cc:330] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: stopping tablet replica
I20260806 16:57:25.042408 13201 raft_consensus.cc:2229] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:25.042635 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12745
I20260806 16:57:25.042631 13203 raft_consensus.cc:2229] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:25.042834 13201 raft_consensus.cc:2258] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:25.044152 13203 raft_consensus.cc:2258] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:25.046595 13203 ts_tablet_manager.cc:1905] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:25.047116 13201 ts_tablet_manager.cc:1905] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:25.050333 13201 ts_tablet_manager.cc:1918] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:25.050477 13201 log.cc:1196] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/281381b201ff42afad1d35c7105417cb
I20260806 16:57:25.050859 13201 ts_tablet_manager.cc:1939] T 281381b201ff42afad1d35c7105417cb P 400753b2411048a49e2c1d508ee31e49: Deleting consensus metadata
I20260806 16:57:25.051273 13203 ts_tablet_manager.cc:1918] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:25.051479 13203 log.cc:1196] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/281381b201ff42afad1d35c7105417cb
I20260806 16:57:25.051995 13203 ts_tablet_manager.cc:1939] T 281381b201ff42afad1d35c7105417cb P a12f8d1224e94e4ca2995b04f0266193: Deleting consensus metadata
I20260806 16:57:25.052546 12664 catalog_manager.cc:4841] TS 400753b2411048a49e2c1d508ee31e49 (127.7.153.3:35713): tablet 281381b201ff42afad1d35c7105417cb (table test-table [id=4ba4897ba87e4fc794db5ad5efcc44a1]) successfully deleted
I20260806 16:57:25.053531 12669 catalog_manager.cc:4841] TS a12f8d1224e94e4ca2995b04f0266193 (127.7.153.2:37173): tablet 281381b201ff42afad1d35c7105417cb (table test-table [id=4ba4897ba87e4fc794db5ad5efcc44a1]) successfully deleted
W20260806 16:57:25.054610 12669 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:37947 (error 108)
I20260806 16:57:25.055562 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12884
I20260806 16:57:25.055852 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:25.055500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37947 (local address 127.0.0.1:49808)
0806 16:57:25.055660 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:25.055743 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:37947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 16:57:25.057370 12669 catalog_manager.cc:4584] TS 3dda5cfaaae54a3f91ba4db0539b9e04 (127.7.153.1:37947): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 281381b201ff42afad1d35c7105417cb: Network error: Client connection negotiation failed: client connection to 127.7.153.1:37947: connect: Connection refused (error 111)
I20260806 16:57:25.067811 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13022
I20260806 16:57:25.076862 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 12649
2026-08-06T16:57:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1105 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 16:57:25.101852 7780 mini_oidc.cc:152] Starting JWKS server
I20260806 16:57:25.103649 7780 webserver.cc:460] Webserver started at https://127.0.0.1:34175/ using document root <none> and password file <none>
I20260806 16:57:25.103804 7780 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 16:57:25.104048 7780 webserver.cc:460] Webserver started at http://127.0.0.1:46263/ using document root <none> and password file <none>
2026-08-06T16:57:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:25Z Disabled control of system clock
I20260806 16:57:25.116631 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:33725
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:33725
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34175/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/testchainca.cert with env {}
W20260806 16:57:25.238143 13211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:25.238497 13211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:25.238541 13211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:25.242867 13211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:25.242957 13211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:25.242974 13211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:25.242992 13211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:25.243008 13211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 16:57:25.243026 13211 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 16:57:25.243039 13211 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34175/jwks.json
I20260806 16:57:25.250049 13211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:33725
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:33725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34175/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:25.251804 13211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:25.253334 13211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:57:25.264803 13211 server_base.cc:1034] running on GCE node
W20260806 16:57:25.264742 13216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:25.264742 13217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:25.264742 13219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:25.265810 13211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:25.267194 13211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:25.268427 13211 hybrid_clock.cc:648] HybridClock initialized: now 1786035445268397 us; error 40 us; skew 500 ppm
I20260806 16:57:25.270926 13211 webserver.cc:460] Webserver started at http://127.7.153.62:38331/ using document root <none> and password file <none>
I20260806 16:57:25.271628 13211 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:25.271746 13211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:25.272027 13211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:25.274722 13211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "29b0fb456b384935b1a2026336dd6345"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "74bf848398905f07a29a7ad92cc7d494"
server_key_iv: "1ba0fb1c7509efc72f6d5fcdc830357f"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.275552 13211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "29b0fb456b384935b1a2026336dd6345"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "74bf848398905f07a29a7ad92cc7d494"
server_key_iv: "1ba0fb1c7509efc72f6d5fcdc830357f"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.280285 13211 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:25.283525 13225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:25.285326 13211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:25.285543 13211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "29b0fb456b384935b1a2026336dd6345"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "74bf848398905f07a29a7ad92cc7d494"
server_key_iv: "1ba0fb1c7509efc72f6d5fcdc830357f"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.285693 13211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:25.308284 13211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:25.309154 13211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:25.309384 13211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:25.317262 13211 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:33725
I20260806 16:57:25.317328 13278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:33725 every 8 connection(s)
I20260806 16:57:25.318363 13211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:25.321935 13279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:25.325594 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13211
I20260806 16:57:25.325742 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:25.326059 7780 external_mini_cluster.cc:1428] Setting key 5e95aea9b2ba752d88b050f306edfebe
I20260806 16:57:25.328913 13279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345: Bootstrap starting.
I20260806 16:57:25.331331 13279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:25.332155 13279 log.cc:824] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:25.334275 13279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345: No bootstrap required, opened a new log
I20260806 16:57:25.336189 13282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:25.327620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53342 (local address 127.7.153.62:33725)
0806 16:57:25.328419 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:25.328437 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:25.328476 (+ 39us) server_negotiation.cc:407] Connection header received
0806 16:57:25.329330 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:25.329351 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:25.329785 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:25.330160 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:25.330662 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.331728 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.332738 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.333238 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.333428 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:25.334316 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:25.334321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:25.334335 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:25.334799 (+ 464us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:25.334861 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:25.334882 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:25.334993 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:25.335163 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 16:57:25.335445 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":163,"threads_started":1}
I20260806 16:57:25.338642 13279 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b0fb456b384935b1a2026336dd6345" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33725 } }
I20260806 16:57:25.338929 13279 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:25.339015 13279 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29b0fb456b384935b1a2026336dd6345, State: Initialized, Role: FOLLOWER
I20260806 16:57:25.339498 13279 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b0fb456b384935b1a2026336dd6345" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33725 } }
I20260806 16:57:25.339551 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:57:25.339633 13279 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:25.339721 13279 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:25.339838 13279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:25.340975 13279 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b0fb456b384935b1a2026336dd6345" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33725 } }
I20260806 16:57:25.341372 13279 leader_election.cc:302] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29b0fb456b384935b1a2026336dd6345; no voters:
I20260806 16:57:25.341753 13279 leader_election.cc:288] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:25.341885 13285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:25.342185 13285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [term 1 LEADER]: Becoming Leader. State: Replica: 29b0fb456b384935b1a2026336dd6345, State: Running, Role: LEADER
I20260806 16:57:25.342597 13285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b0fb456b384935b1a2026336dd6345" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33725 } }
I20260806 16:57:25.343183 13279 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:25.344483 13288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29b0fb456b384935b1a2026336dd6345. Latest consensus state: current_term: 1 leader_uuid: "29b0fb456b384935b1a2026336dd6345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b0fb456b384935b1a2026336dd6345" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33725 } } }
I20260806 16:57:25.344627 13288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:25.345031 13286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29b0fb456b384935b1a2026336dd6345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b0fb456b384935b1a2026336dd6345" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33725 } } }
I20260806 16:57:25.345181 13286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:25.345116 13295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:25.349100 13295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:25.355472 13295 catalog_manager.cc:1347] Generated new cluster ID: 9ac57a2c84634b40bbdd95e2e48b27f5
I20260806 16:57:25.355573 13295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:25.364660 13295 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:25.366088 13295 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:25.378753 13295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29b0fb456b384935b1a2026336dd6345: Generated new TSK 0
I20260806 16:57:25.379860 13295 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 16:57:25.409842 13311 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 16:57:25.410040 13311 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 16:57:25.410686 13282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:25.391687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53358 (local address 127.7.153.62:33725)
0806 16:57:25.391845 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:25.391850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:25.392022 (+ 172us) server_negotiation.cc:407] Connection header received
0806 16:57:25.392251 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:25.392256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:25.392323 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:25.392456 (+ 133us) server_negotiation.cc:226] Negotiated authn=JWT
0806 16:57:25.392743 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.393631 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.394533 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.394892 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.395023 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:25.395434 (+ 411us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 16:57:25.410207 (+ 14773us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 16:57:25.410522 (+ 315us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 16:57:25.410758 13282 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 16:57:25.412084 13310 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:25.391542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33725 (local address 127.0.0.1:53358)
0806 16:57:25.391934 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:25.391948 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:25.392071 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:25.392472 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:25.392475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:25.392481 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0806 16:57:25.392612 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:25.392616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.393760 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.393763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:25.394409 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:25.394417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.395054 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.395057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:25.395137 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:25.395196 (+ 59us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 16:57:25.410495 (+ 15299us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 16:57:25.410736 (+ 241us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.153.62:33725: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":104,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.7.153.62:33725: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34175/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 16:57:25.412919 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13211
2026-08-06T16:57:25Z chronyd exiting
I20260806 16:57:25.454916 7780 test_util.cc:175] -----------------------------------------------
I20260806 16:57:25.455014 7780 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786035416626244-7780-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (355 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 16:57:25.456197 7780 mini_oidc.cc:152] Starting JWKS server
I20260806 16:57:25.457250 7780 webserver.cc:460] Webserver started at https://127.0.0.1:40009/ using document root <none> and password file <none>
I20260806 16:57:25.457369 7780 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 16:57:25.457675 7780 webserver.cc:460] Webserver started at http://127.0.0.1:41207/ using document root <none> and password file <none>
2026-08-06T16:57:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:25Z Disabled control of system clock
I20260806 16:57:25.469496 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44201
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:46217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:44201
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40009/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/testchainca.cert with env {}
W20260806 16:57:25.597362 13319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:25.597697 13319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:25.597740 13319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:25.602008 13319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:25.602095 13319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:25.602113 13319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:25.602129 13319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:25.602145 13319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 16:57:25.602162 13319 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 16:57:25.602175 13319 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40009/jwks.json
I20260806 16:57:25.608031 13319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:44201
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40009/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:25.609333 13319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:25.610427 13319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:57:25.619670 13319 server_base.cc:1034] running on GCE node
W20260806 16:57:25.619609 13324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:25.619642 13328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:25.619612 13326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:25.620543 13319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:25.621867 13319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:25.623087 13319 hybrid_clock.cc:648] HybridClock initialized: now 1786035445623057 us; error 57 us; skew 500 ppm
I20260806 16:57:25.625434 13319 webserver.cc:460] Webserver started at http://127.7.153.62:40167/ using document root <none> and password file <none>
I20260806 16:57:25.626106 13319 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:25.626179 13319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:25.626412 13319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:25.629438 13319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "0481a2cf64c74408a46d4e832924717b"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "cd117a4e4853ad3122ed44f01052b3f8"
server_key_iv: "7defcf3c2742703397384a9662d2506b"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.630132 13319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "0481a2cf64c74408a46d4e832924717b"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "cd117a4e4853ad3122ed44f01052b3f8"
server_key_iv: "7defcf3c2742703397384a9662d2506b"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.634460 13319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:25.637363 13335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:25.638896 13319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:25.639078 13319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "0481a2cf64c74408a46d4e832924717b"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "cd117a4e4853ad3122ed44f01052b3f8"
server_key_iv: "7defcf3c2742703397384a9662d2506b"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.639221 13319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:25.659513 13319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:25.660351 13319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:25.660578 13319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:25.668525 13319 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:44201
I20260806 16:57:25.668529 13389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:44201 every 8 connection(s)
I20260806 16:57:25.669710 13319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:25.673220 13390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:25.677830 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13319
I20260806 16:57:25.677943 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:25.678224 7780 external_mini_cluster.cc:1428] Setting key e73b50646279871b08c76eda3a7899d2
I20260806 16:57:25.679706 13390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b: Bootstrap starting.
I20260806 16:57:25.682449 13390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:25.683300 13390 log.cc:824] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:25.685779 13390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b: No bootstrap required, opened a new log
I20260806 16:57:25.689036 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:25.679807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48590 (local address 127.7.153.62:44201)
0806 16:57:25.680649 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:25.680670 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:25.680807 (+ 137us) server_negotiation.cc:407] Connection header received
0806 16:57:25.681736 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:25.681759 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:25.682192 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:25.682599 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:25.683074 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.684343 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.685328 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.685829 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.686016 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:25.686925 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:25.686931 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:25.686945 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:25.687361 (+ 416us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:25.687419 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:25.687439 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:25.687572 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:25.687707 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 16:57:25.687992 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":146,"threads_started":1}
I20260806 16:57:25.689720 13390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0481a2cf64c74408a46d4e832924717b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44201 } }
I20260806 16:57:25.690044 13390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:25.690117 13390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0481a2cf64c74408a46d4e832924717b, State: Initialized, Role: FOLLOWER
I20260806 16:57:25.690644 13390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0481a2cf64c74408a46d4e832924717b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44201 } }
I20260806 16:57:25.690826 13390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:25.690912 13390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:25.691035 13390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:25.692225 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:57:25.692397 13390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0481a2cf64c74408a46d4e832924717b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44201 } }
I20260806 16:57:25.692893 13390 leader_election.cc:302] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0481a2cf64c74408a46d4e832924717b; no voters:
I20260806 16:57:25.693393 13390 leader_election.cc:288] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:25.693495 13395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:25.693776 13395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [term 1 LEADER]: Becoming Leader. State: Replica: 0481a2cf64c74408a46d4e832924717b, State: Running, Role: LEADER
I20260806 16:57:25.694116 13395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0481a2cf64c74408a46d4e832924717b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44201 } }
I20260806 16:57:25.695406 13390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:25.695986 13396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0481a2cf64c74408a46d4e832924717b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0481a2cf64c74408a46d4e832924717b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44201 } } }
I20260806 16:57:25.696014 13397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0481a2cf64c74408a46d4e832924717b. Latest consensus state: current_term: 1 leader_uuid: "0481a2cf64c74408a46d4e832924717b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0481a2cf64c74408a46d4e832924717b" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44201 } } }
I20260806 16:57:25.696179 13397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:25.696179 13396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:25.696586 13399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:25.700381 13399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:25.707748 13399 catalog_manager.cc:1347] Generated new cluster ID: deb1854338174bf6925275a1f2082266
I20260806 16:57:25.707871 13399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:25.725993 13399 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:25.727150 13399 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:25.733420 13399 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0481a2cf64c74408a46d4e832924717b: Generated new TSK 0
I20260806 16:57:25.734268 13399 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 16:57:25.763973 13423 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 16:57:25.764106 13423 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 16:57:25.764910 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:25.745511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48596 (local address 127.7.153.62:44201)
0806 16:57:25.745653 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:25.745657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:25.745919 (+ 262us) server_negotiation.cc:407] Connection header received
0806 16:57:25.746143 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:25.746146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:25.746225 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:25.746347 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0806 16:57:25.746613 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.747174 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.748573 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.749076 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.749227 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:25.749727 (+ 500us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 16:57:25.764440 (+ 14713us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 16:57:25.764788 (+ 348us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48596: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 16:57:25.764995 13393 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48596: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 16:57:25.765144 13422 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:25.745400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44201 (local address 127.0.0.1:48596)
0806 16:57:25.745796 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:25.745812 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:25.745940 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:25.746367 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:25.746370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:25.746378 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 16:57:25.746498 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:25.746504 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.747290 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.747294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:25.748320 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:25.748332 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:25.749264 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:25.749269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:25.749373 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:25.749420 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 16:57:25.764683 (+ 15263us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 16:57:25.764933 (+ 250us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.153.62:44201: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":120,"threads_started":1}
I20260806 16:57:25.765990 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13319
2026-08-06T16:57:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (353 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 16:57:25.809854 7780 mini_oidc.cc:152] Starting JWKS server
I20260806 16:57:25.810799 7780 webserver.cc:460] Webserver started at https://127.0.0.1:45817/ using document root <none> and password file <none>
I20260806 16:57:25.810890 7780 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 16:57:25.811105 7780 webserver.cc:460] Webserver started at http://127.0.0.1:37251/ using document root <none> and password file <none>
2026-08-06T16:57:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:25Z Disabled control of system clock
I20260806 16:57:25.826025 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42485
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:44375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42485
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45817/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 16:57:25.946523 13430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:25.946844 13430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:25.946887 13430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:25.951347 13430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:25.951442 13430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:25.951457 13430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:25.951474 13430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:25.951491 13430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 16:57:25.951507 13430 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 16:57:25.951566 13430 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45817/jwks.json
I20260806 16:57:25.956845 13430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42485
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45817/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:25.958189 13430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:25.959807 13430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:25.969509 13435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:25.969498 13436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:25.969872 13430 server_base.cc:1034] running on GCE node
W20260806 16:57:25.969970 13438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:25.970619 13430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:25.971863 13430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:25.973048 13430 hybrid_clock.cc:648] HybridClock initialized: now 1786035445973015 us; error 52 us; skew 500 ppm
I20260806 16:57:25.975263 13430 webserver.cc:460] Webserver started at http://127.7.153.62:37295/ using document root <none> and password file <none>
I20260806 16:57:25.975914 13430 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:25.975984 13430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:25.976178 13430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:25.978542 13430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "c21741c6887cbaa27bcae18f5d87015f"
server_key_iv: "c1d7435e33440b8246121a4aae276dfe"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.979115 13430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "c21741c6887cbaa27bcae18f5d87015f"
server_key_iv: "c1d7435e33440b8246121a4aae276dfe"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.983268 13430 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:25.986366 13444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:25.987879 13430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:57:25.988062 13430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd"
format_stamp: "Formatted at 2026-08-06 16:57:25 on dist-test-slave-cbsf"
server_key: "c21741c6887cbaa27bcae18f5d87015f"
server_key_iv: "c1d7435e33440b8246121a4aae276dfe"
server_key_version: "encryptionkey@0"
I20260806 16:57:25.988215 13430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:26.002537 13430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:26.003368 13430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:26.003605 13430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:26.012092 13430 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42485
I20260806 16:57:26.012097 13499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42485 every 8 connection(s)
I20260806 16:57:26.013387 13430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:26.014325 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13430
I20260806 16:57:26.014425 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:26.014719 7780 external_mini_cluster.cc:1428] Setting key e83d6beca256908851e0cba577ad2b75
I20260806 16:57:26.017905 13500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:26.025910 13500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd: Bootstrap starting.
I20260806 16:57:26.026374 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:26.016283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37936 (local address 127.7.153.62:42485)
0806 16:57:26.017069 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:26.017091 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:26.017137 (+ 46us) server_negotiation.cc:407] Connection header received
0806 16:57:26.018128 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:26.018154 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:26.018694 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:26.019102 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:26.019589 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.021143 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.022147 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.022870 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.023054 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:26.024051 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:26.024060 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:26.024080 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:26.024655 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:26.024779 (+ 124us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:26.024808 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:26.024913 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:26.025081 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 16:57:26.025380 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":148,"threads_started":1}
I20260806 16:57:26.028602 13500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:26.029521 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:57:26.029552 13500 log.cc:824] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:26.031855 13500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd: No bootstrap required, opened a new log
I20260806 16:57:26.035996 13500 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42485 } }
I20260806 16:57:26.036325 13500 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:26.036393 13500 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5be6474d1e1a46c5ab2b343b3b2ae7cd, State: Initialized, Role: FOLLOWER
I20260806 16:57:26.036911 13500 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42485 } }
I20260806 16:57:26.037048 13500 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:26.037101 13500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:26.037194 13500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:26.038233 13500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42485 } }
I20260806 16:57:26.038556 13500 leader_election.cc:302] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5be6474d1e1a46c5ab2b343b3b2ae7cd; no voters:
I20260806 16:57:26.038851 13500 leader_election.cc:288] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:26.039023 13505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:26.039331 13505 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [term 1 LEADER]: Becoming Leader. State: Replica: 5be6474d1e1a46c5ab2b343b3b2ae7cd, State: Running, Role: LEADER
I20260806 16:57:26.039660 13505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42485 } }
I20260806 16:57:26.040277 13500 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:26.041452 13507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5be6474d1e1a46c5ab2b343b3b2ae7cd. Latest consensus state: current_term: 1 leader_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42485 } } }
I20260806 16:57:26.041602 13507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:26.041901 13506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5be6474d1e1a46c5ab2b343b3b2ae7cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42485 } } }
I20260806 16:57:26.042003 13506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:26.042160 13514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:26.045727 13514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:26.052518 13514 catalog_manager.cc:1347] Generated new cluster ID: 968d15cb1d8c44fdbbe43e1a27bce3a6
I20260806 16:57:26.052636 13514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:26.074344 13514 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:26.075489 13514 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:26.086952 13514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5be6474d1e1a46c5ab2b343b3b2ae7cd: Generated new TSK 0
I20260806 16:57:26.087813 13514 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:57:26.107538 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:26.099459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37942 (local address 127.7.153.62:42485)
0806 16:57:26.099619 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:26.099624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:26.099799 (+ 175us) server_negotiation.cc:407] Connection header received
0806 16:57:26.100006 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:26.100009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:26.100066 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:26.100171 (+ 105us) server_negotiation.cc:226] Negotiated authn=JWT
0806 16:57:26.100428 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.101066 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.102345 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.102575 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.102667 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:26.103173 (+ 506us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 16:57:26.107104 (+ 3931us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 16:57:26.107382 (+ 278us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37942: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 16:57:26.107620 13503 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37942: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 16:57:26.109386 13530 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:26.099364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42485 (local address 127.0.0.1:37942)
0806 16:57:26.099695 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:26.099713 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:26.099844 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:26.100187 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:26.100190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:26.100198 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 16:57:26.100320 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:26.100326 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.101190 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.101194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:26.102209 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:26.102220 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.102782 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.102787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:26.102886 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:26.102921 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 16:57:26.107332 (+ 4411us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 16:57:26.109184 (+ 1852us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.153.62:42485: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45817/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":1574,"thread_start_us":118,"threads_started":1}
I20260806 16:57:26.110078 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13430
E20260806 16:57:26.122355 13531 webserver.cc:533] Webserver: sslize failed:
E20260806 16:57:26.122483 13531 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T16:57:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (344 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T16:57:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:26Z Disabled control of system clock
I20260806 16:57:26.165028 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:35591
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:36471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:35591
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/testchainca.cert with env {}
W20260806 16:57:26.284936 13535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:26.285250 13535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:26.285293 13535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:26.289561 13535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:26.289646 13535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:26.289662 13535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:26.289680 13535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:26.289695 13535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 16:57:26.289712 13535 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 16:57:26.289781 13535 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 16:57:26.295683 13535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:36471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:35591
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:35591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:26.296976 13535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:26.298106 13535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:26.307709 13545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:26.307739 13535 server_base.cc:1034] running on GCE node
W20260806 16:57:26.307758 13543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:26.307775 13542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:26.308655 13535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:26.309933 13535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:26.311117 13535 hybrid_clock.cc:648] HybridClock initialized: now 1786035446311084 us; error 52 us; skew 500 ppm
I20260806 16:57:26.313273 13535 webserver.cc:460] Webserver started at http://127.7.153.62:40307/ using document root <none> and password file <none>
I20260806 16:57:26.313926 13535 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:26.314047 13535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:26.314275 13535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:26.316582 13535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "be7e5dbce0e84508b654528b56e1077d"
format_stamp: "Formatted at 2026-08-06 16:57:26 on dist-test-slave-cbsf"
server_key: "1304693c2699cf76c0c2405d80bcc705"
server_key_iv: "84da3262c04a17ef1e8a0cf96c954be0"
server_key_version: "encryptionkey@0"
I20260806 16:57:26.317373 13535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "be7e5dbce0e84508b654528b56e1077d"
format_stamp: "Formatted at 2026-08-06 16:57:26 on dist-test-slave-cbsf"
server_key: "1304693c2699cf76c0c2405d80bcc705"
server_key_iv: "84da3262c04a17ef1e8a0cf96c954be0"
server_key_version: "encryptionkey@0"
I20260806 16:57:26.321614 13535 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:26.324381 13551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:26.325856 13535 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:26.325979 13535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "be7e5dbce0e84508b654528b56e1077d"
format_stamp: "Formatted at 2026-08-06 16:57:26 on dist-test-slave-cbsf"
server_key: "1304693c2699cf76c0c2405d80bcc705"
server_key_iv: "84da3262c04a17ef1e8a0cf96c954be0"
server_key_version: "encryptionkey@0"
I20260806 16:57:26.326092 13535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:26.356168 13535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:26.357009 13535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:26.357204 13535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:26.366654 13535 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:35591
I20260806 16:57:26.367643 13609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:35591 every 8 connection(s)
I20260806 16:57:26.368170 13535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:26.372153 13610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:26.373263 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13535
I20260806 16:57:26.373430 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:26.373785 7780 external_mini_cluster.cc:1428] Setting key 392e43160cb3e55ceae86a77aa96ed2f
I20260806 16:57:26.383522 13610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d: Bootstrap starting.
I20260806 16:57:26.386693 13610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:26.387522 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:26.375433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39566 (local address 127.7.153.62:35591)
0806 16:57:26.376428 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:26.376453 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:26.376500 (+ 47us) server_negotiation.cc:407] Connection header received
0806 16:57:26.378028 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:26.378062 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:26.378726 (+ 664us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:26.379195 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:26.379726 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.381537 (+ 1811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.382764 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.383314 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.383522 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:26.384574 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:26.384583 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:26.384603 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:57:26.385318 (+ 715us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:26.385419 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:57:26.385471 (+ 52us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:26.385578 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:26.385779 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 16:57:26.386276 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":192,"threads_started":1}
I20260806 16:57:26.388917 13610 log.cc:824] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:26.391247 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:57:26.391881 13610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d: No bootstrap required, opened a new log
I20260806 16:57:26.398126 13610 raft_consensus.cc:348] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7e5dbce0e84508b654528b56e1077d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 35591 } }
I20260806 16:57:26.398516 13610 raft_consensus.cc:374] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:26.398588 13610 raft_consensus.cc:729] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be7e5dbce0e84508b654528b56e1077d, State: Initialized, Role: FOLLOWER
I20260806 16:57:26.399152 13610 consensus_queue.cc:260] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7e5dbce0e84508b654528b56e1077d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 35591 } }
I20260806 16:57:26.399333 13610 raft_consensus.cc:388] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:26.399420 13610 raft_consensus.cc:482] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:26.399544 13610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:26.401185 13610 raft_consensus.cc:504] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7e5dbce0e84508b654528b56e1077d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 35591 } }
I20260806 16:57:26.401700 13610 leader_election.cc:302] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be7e5dbce0e84508b654528b56e1077d; no voters:
I20260806 16:57:26.402217 13610 leader_election.cc:288] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:26.402362 13615 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:26.402647 13615 raft_consensus.cc:686] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [term 1 LEADER]: Becoming Leader. State: Replica: be7e5dbce0e84508b654528b56e1077d, State: Running, Role: LEADER
I20260806 16:57:26.403009 13615 consensus_queue.cc:237] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7e5dbce0e84508b654528b56e1077d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 35591 } }
I20260806 16:57:26.403862 13610 sys_catalog.cc:564] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:26.405233 13616 sys_catalog.cc:455] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be7e5dbce0e84508b654528b56e1077d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7e5dbce0e84508b654528b56e1077d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 35591 } } }
I20260806 16:57:26.405393 13616 sys_catalog.cc:458] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:26.405722 13617 sys_catalog.cc:455] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [sys.catalog]: SysCatalogTable state changed. Reason: New leader be7e5dbce0e84508b654528b56e1077d. Latest consensus state: current_term: 1 leader_uuid: "be7e5dbce0e84508b654528b56e1077d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be7e5dbce0e84508b654528b56e1077d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 35591 } } }
I20260806 16:57:26.405838 13624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:26.406185 13617 sys_catalog.cc:458] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:26.409612 13624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:26.419278 13624 catalog_manager.cc:1347] Generated new cluster ID: 067be5017be343579526e05417d68c39
I20260806 16:57:26.419390 13624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:26.438553 13624 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:26.439703 13624 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:26.454891 13624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be7e5dbce0e84508b654528b56e1077d: Generated new TSK 0
I20260806 16:57:26.455770 13624 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:57:26.898751 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:26.477268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39574 (local address 127.7.153.62:35591)
0806 16:57:26.477431 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:26.477437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:26.477609 (+ 172us) server_negotiation.cc:407] Connection header received
0806 16:57:26.477823 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:26.477826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:26.477894 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:26.477991 (+ 97us) server_negotiation.cc:226] Negotiated authn=JWT
0806 16:57:26.478394 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.479100 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.480559 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.480940 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.481060 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:26.481457 (+ 397us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 16:57:26.898312 (+416855us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 16:57:26.898616 (+ 304us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39574: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":63}
W20260806 16:57:26.898871 13613 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39574: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 16:57:26.899085 13641 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:26.477172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:35591 (local address 127.0.0.1:39574)
0806 16:57:26.477496 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:26.477514 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:26.477655 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:26.478022 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:26.478026 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:26.478034 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 16:57:26.478168 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:26.478174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.479301 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.479306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:26.480358 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:26.480370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:26.481103 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:26.481107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:26.481219 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:26.481254 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 16:57:26.898629 (+417375us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 16:57:26.898851 (+ 222us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.153.62:35591: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":125,"threads_started":1}
I20260806 16:57:26.900079 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13535
2026-08-06T16:57:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (768 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (146 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (141 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:27 dist-test-slave-cbsf krb5kdc[13653](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:27 dist-test-slave-cbsf krb5kdc[13653](info): set up 2 sockets
Aug 06 16:57:27 dist-test-slave-cbsf krb5kdc[13653](info): commencing operation
krb5kdc: starting...
W20260806 16:57:28.278007 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:28 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:28.420957 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42295
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:28.543295 13667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:28.543685 13667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:28.543768 13667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:28.548071 13667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:28.548204 13667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:28.548238 13667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:28.548271 13667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:28.548307 13667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:28.554262 13667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:28.555543 13667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:28.556769 13667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:57:28.566042 13667 server_base.cc:1034] running on GCE node
W20260806 16:57:28.565969 13673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:28.565968 13672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:28.566010 13675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:28.566951 13667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:28.568262 13667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:28.569459 13667 hybrid_clock.cc:648] HybridClock initialized: now 1786035448569414 us; error 63 us; skew 500 ppm
Aug 06 16:57:28 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035448, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:28.577090 13667 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:28.578329 13667 webserver.cc:460] Webserver started at http://127.7.153.62:37557/ using document root <none> and password file <none>
I20260806 16:57:28.579022 13667 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:28.579092 13667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:28.579357 13667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:28.581837 13667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c780ece1678247d29b469340f0d9348c"
format_stamp: "Formatted at 2026-08-06 16:57:28 on dist-test-slave-cbsf"
server_key: "c658f226567b79034f86505abb881d26"
server_key_iv: "eb9c73b2e2373ee26951278290d2bd8f"
server_key_version: "encryptionkey@0"
I20260806 16:57:28.582485 13667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c780ece1678247d29b469340f0d9348c"
format_stamp: "Formatted at 2026-08-06 16:57:28 on dist-test-slave-cbsf"
server_key: "c658f226567b79034f86505abb881d26"
server_key_iv: "eb9c73b2e2373ee26951278290d2bd8f"
server_key_version: "encryptionkey@0"
I20260806 16:57:28.586763 13667 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 16:57:28.589761 13683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:28.591162 13667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:28.591325 13667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c780ece1678247d29b469340f0d9348c"
format_stamp: "Formatted at 2026-08-06 16:57:28 on dist-test-slave-cbsf"
server_key: "c658f226567b79034f86505abb881d26"
server_key_iv: "eb9c73b2e2373ee26951278290d2bd8f"
server_key_version: "encryptionkey@0"
I20260806 16:57:28.591452 13667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:28.613341 13667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:28.617072 13667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:28.617321 13667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:28.625619 13667 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42295
I20260806 16:57:28.625653 13738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42295 every 8 connection(s)
I20260806 16:57:28.626755 13667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:28.630021 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13667
I20260806 16:57:28.630187 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:28.630260 13740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:28.630556 7780 external_mini_cluster.cc:1428] Setting key ec72d80c7c51532965ac7a7091a2370c
I20260806 16:57:28.638159 13740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c: Bootstrap starting.
I20260806 16:57:28.641259 13740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c: Neither blocks nor log segments found. Creating new log.
Aug 06 16:57:28 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:28.642405 13740 log.cc:824] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:28.645179 13740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c: No bootstrap required, opened a new log
I20260806 16:57:28.648316 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:28.632295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54838 (local address 127.7.153.62:42295)
0806 16:57:28.633169 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:28.633300 (+ 131us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:28.633353 (+ 53us) server_negotiation.cc:407] Connection header received
0806 16:57:28.634139 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:28.634161 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:28.634536 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:28.634939 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:28.635896 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:28.637199 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:28.638111 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:28.638689 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:28.638868 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:28.642668 (+ 3800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:28.642675 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:28.642692 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:28.642727 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:28.645064 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:28.645719 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:28.645724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:28.645730 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:28.645855 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:28.646194 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:28.646196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:28.646197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:28.646640 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:28.646792 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:28.647152 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 16:57:28.647484 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":167,"threads_started":1}
I20260806 16:57:28.649967 13740 raft_consensus.cc:348] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c780ece1678247d29b469340f0d9348c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42295 } }
I20260806 16:57:28.650240 13740 raft_consensus.cc:374] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:28.650309 13740 raft_consensus.cc:729] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c780ece1678247d29b469340f0d9348c, State: Initialized, Role: FOLLOWER
I20260806 16:57:28.650825 13740 consensus_queue.cc:260] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c780ece1678247d29b469340f0d9348c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42295 } }
I20260806 16:57:28.650961 13740 raft_consensus.cc:388] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:28.651058 13740 raft_consensus.cc:482] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:28.651223 13740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:28.652382 13740 raft_consensus.cc:504] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c780ece1678247d29b469340f0d9348c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42295 } }
I20260806 16:57:28.652856 13740 leader_election.cc:302] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c780ece1678247d29b469340f0d9348c; no voters:
I20260806 16:57:28.653285 13740 leader_election.cc:288] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:28.653436 13745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:28.653685 13745 raft_consensus.cc:686] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [term 1 LEADER]: Becoming Leader. State: Replica: c780ece1678247d29b469340f0d9348c, State: Running, Role: LEADER
I20260806 16:57:28.654007 13745 consensus_queue.cc:237] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c780ece1678247d29b469340f0d9348c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42295 } }
I20260806 16:57:28.654757 13740 sys_catalog.cc:564] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:28.656069 13747 sys_catalog.cc:455] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c780ece1678247d29b469340f0d9348c. Latest consensus state: current_term: 1 leader_uuid: "c780ece1678247d29b469340f0d9348c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c780ece1678247d29b469340f0d9348c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42295 } } }
I20260806 16:57:28.656229 13747 sys_catalog.cc:458] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:28.656205 13746 sys_catalog.cc:455] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c780ece1678247d29b469340f0d9348c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c780ece1678247d29b469340f0d9348c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42295 } } }
I20260806 16:57:28.656404 13746 sys_catalog.cc:458] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c [sys.catalog]: This master's current role is: LEADER
W20260806 16:57:28.660429 13760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:28.660571 13760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:28.660735 13754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:28.661566 13754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:28.667929 13754 catalog_manager.cc:1347] Generated new cluster ID: 861a7eb5eea1479bb1dbdf7d03378852
I20260806 16:57:28.668030 13754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:28.696141 13754 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:28.697647 13754 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:28.715024 13754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c780ece1678247d29b469340f0d9348c: Generated new TSK 0
I20260806 16:57:28.716032 13754 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:28.759626 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42295
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:28.882721 13766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:28.883041 13766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:28.883088 13766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:28.887425 13766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:28.887537 13766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:28.887645 13766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:28.893362 13766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:28.894632 13766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:28.895810 13766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:57:28.906248 13766 server_base.cc:1034] running on GCE node
W20260806 16:57:28.906230 13774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:28.906235 13771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:28.906436 13772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:28.906906 13766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:28.907554 13766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:28.908802 13766 hybrid_clock.cc:648] HybridClock initialized: now 1786035448908780 us; error 35 us; skew 500 ppm
Aug 06 16:57:28 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035448, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:28.911813 13766 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:28.912933 13766 webserver.cc:460] Webserver started at http://127.7.153.1:35755/ using document root <none> and password file <none>
I20260806 16:57:28.913558 13766 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:28.913661 13766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:28.913916 13766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:28.916203 13766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "322560510367495ba209fdec99893ec4"
format_stamp: "Formatted at 2026-08-06 16:57:28 on dist-test-slave-cbsf"
server_key: "d5e453ba2ffd2f0fa4b0b960235f48a5"
server_key_iv: "0afb18fb4d2ba2c0c0d3254220c183c7"
server_key_version: "encryptionkey@0"
I20260806 16:57:28.916906 13766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "322560510367495ba209fdec99893ec4"
format_stamp: "Formatted at 2026-08-06 16:57:28 on dist-test-slave-cbsf"
server_key: "d5e453ba2ffd2f0fa4b0b960235f48a5"
server_key_iv: "0afb18fb4d2ba2c0c0d3254220c183c7"
server_key_version: "encryptionkey@0"
I20260806 16:57:28.921128 13766 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:28.923862 13781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:28.925295 13766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:28.925457 13766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "322560510367495ba209fdec99893ec4"
format_stamp: "Formatted at 2026-08-06 16:57:28 on dist-test-slave-cbsf"
server_key: "d5e453ba2ffd2f0fa4b0b960235f48a5"
server_key_iv: "0afb18fb4d2ba2c0c0d3254220c183c7"
server_key_version: "encryptionkey@0"
I20260806 16:57:28.925592 13766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:28.941136 13766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:28.944860 13766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:28.945096 13766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:28.945796 13766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:28.946745 13766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:28.946821 13766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:28.946898 13766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:28.946943 13766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:28.957792 13766 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:41253
I20260806 16:57:28.957809 13902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:41253 every 8 connection(s)
I20260806 16:57:28.958818 13766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:28.969175 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13766
I20260806 16:57:28.969339 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
Aug 06 16:57:28 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035448, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:28.969672 7780 external_mini_cluster.cc:1428] Setting key ffce799005d705258e9a934a0975628f
I20260806 16:57:28.974436 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:28.960943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:34495 (local address 127.7.153.62:42295)
0806 16:57:28.961123 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:28.961126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:28.962092 (+ 966us) server_negotiation.cc:407] Connection header received
0806 16:57:28.963615 (+ 1523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:28.963625 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:28.963692 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:28.963778 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:28.965079 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:28.965650 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:28.966815 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:28.967066 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:28.967164 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:28.970083 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:28.970088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:28.970091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:28.970126 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:28.971915 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:28.972508 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:28.972515 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:28.972520 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:28.972621 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:28.973051 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:28.973057 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:28.973062 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:28.973360 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:28.973469 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:28.974040 (+ 571us) server_negotiation.cc:299] Negotiation successful
0806 16:57:28.974203 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 16:57:28.975350 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:28.961355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42295 (local address 127.7.153.1:34495)
0806 16:57:28.961902 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:28.961950 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:28.963376 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:28.963958 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:28.963965 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:28.964371 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:28.964919 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:28.964933 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:28.965772 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:28.965774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:28.966694 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:28.966704 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:28.967246 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:28.967249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:28.967421 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:28.968112 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:28.968137 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:28.969869 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:28.972068 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:28.972074 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:28.972090 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:28.972387 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:28.972773 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:28.972776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:28.972777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:28.972941 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:28.973467 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:28.973473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:28.973754 (+ 281us) client_negotiation.cc:769] Sending connection context
0806 16:57:28.973926 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 16:57:28.974239 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":141,"threads_started":1}
I20260806 16:57:28.976953 13903 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42295
I20260806 16:57:28.977281 13903 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:28.977993 13903 heartbeater.cc:511] Master 127.7.153.62:42295 requested a full tablet report, sending...
I20260806 16:57:28.980026 13701 ts_manager.cc:194] Registered new tserver with Master: 322560510367495ba209fdec99893ec4 (127.7.153.1:41253)
I20260806 16:57:28.981854 13701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:34495
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:29.004518 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42295
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:29.127022 13909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:29.127421 13909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:29.127511 13909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:29.132323 13909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:29.132440 13909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:29.132546 13909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:29.138468 13909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:29.139786 13909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:29.140960 13909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:29.151865 13914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:29.151849 13915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:29.151849 13918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:29.152037 13909 server_base.cc:1034] running on GCE node
I20260806 16:57:29.152787 13909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:29.153481 13909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:29.154686 13909 hybrid_clock.cc:648] HybridClock initialized: now 1786035449154645 us; error 56 us; skew 500 ppm
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.158250 13909 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:29.159277 13909 webserver.cc:460] Webserver started at http://127.7.153.2:45099/ using document root <none> and password file <none>
I20260806 16:57:29.159871 13909 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:29.159935 13909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:29.160123 13909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:29.162510 13909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "d5333a025f57420cad20e7a28a531da9"
format_stamp: "Formatted at 2026-08-06 16:57:29 on dist-test-slave-cbsf"
server_key: "dc1660570a4f95268ddf3ce106d65b8b"
server_key_iv: "20c92ccf722d2a321ef05d78ba4205f4"
server_key_version: "encryptionkey@0"
I20260806 16:57:29.163157 13909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "d5333a025f57420cad20e7a28a531da9"
format_stamp: "Formatted at 2026-08-06 16:57:29 on dist-test-slave-cbsf"
server_key: "dc1660570a4f95268ddf3ce106d65b8b"
server_key_iv: "20c92ccf722d2a321ef05d78ba4205f4"
server_key_version: "encryptionkey@0"
I20260806 16:57:29.167497 13909 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 16:57:29.170426 13925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:29.171794 13909 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:57:29.171947 13909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "d5333a025f57420cad20e7a28a531da9"
format_stamp: "Formatted at 2026-08-06 16:57:29 on dist-test-slave-cbsf"
server_key: "dc1660570a4f95268ddf3ce106d65b8b"
server_key_iv: "20c92ccf722d2a321ef05d78ba4205f4"
server_key_version: "encryptionkey@0"
I20260806 16:57:29.172075 13909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:29.201134 13909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:29.204888 13909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:29.205145 13909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:29.205845 13909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:29.206805 13909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:29.206885 13909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:29.206960 13909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:29.207005 13909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:29.217036 13909 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:40083
I20260806 16:57:29.217049 14049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:40083 every 8 connection(s)
I20260806 16:57:29.218129 13909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:29.223661 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 13909
I20260806 16:57:29.223763 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:29.224079 7780 external_mini_cluster.cc:1428] Setting key f63c4a7d2065bf0ca7f516cb2cfc71a1
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:29.235185 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.220207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:43747 (local address 127.7.153.62:42295)
0806 16:57:29.220381 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.220385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.221323 (+ 938us) server_negotiation.cc:407] Connection header received
0806 16:57:29.222810 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.222813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.222878 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.222981 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.224426 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.225260 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.227187 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.227435 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.227535 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.230659 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:29.230667 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:29.230673 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:29.230712 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:29.232558 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.233215 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.233219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.233221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.233325 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.233696 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.233701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.233703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.233997 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:29.234135 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:29.234795 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 16:57:29.234953 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:57:29.236140 14053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.220605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42295 (local address 127.7.153.2:43747)
0806 16:57:29.221160 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:29.221208 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:29.222551 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:29.223177 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:29.223184 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:29.223609 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:29.224263 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:29.224281 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.225441 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.225447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:29.227012 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:29.227028 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.227623 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.227630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:29.227887 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.228633 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:29.228650 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:29.230436 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:29.232781 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:29.232787 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:29.232804 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:29.233093 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:29.233431 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:29.233433 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:29.233435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:29.233575 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:29.234150 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:29.234156 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:29.234467 (+ 311us) client_negotiation.cc:769] Sending connection context
0806 16:57:29.234683 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 16:57:29.235007 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":126,"threads_started":1}
I20260806 16:57:29.237574 14051 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42295
I20260806 16:57:29.237828 14051 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:29.238415 14051 heartbeater.cc:511] Master 127.7.153.62:42295 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:29.239725 13701 ts_manager.cc:194] Registered new tserver with Master: d5333a025f57420cad20e7a28a531da9 (127.7.153.2:40083)
I20260806 16:57:29.240357 13701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:43747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:29.256381 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42295
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:29.380064 14056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:29.380414 14056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:29.380498 14056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:29.384850 14056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:29.384945 14056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:29.385057 14056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:29.390666 14056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:29.391947 14056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:29.393098 14056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:29.403681 14061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:29.403676 14062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:29.403676 14064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:29.404162 14056 server_base.cc:1034] running on GCE node
I20260806 16:57:29.404596 14056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:29.405370 14056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:29.406610 14056 hybrid_clock.cc:648] HybridClock initialized: now 1786035449406593 us; error 39 us; skew 500 ppm
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.409726 14056 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:29.410687 14056 webserver.cc:460] Webserver started at http://127.7.153.3:43823/ using document root <none> and password file <none>
I20260806 16:57:29.411334 14056 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:29.411425 14056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:29.411670 14056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:29.414040 14056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "f77d18725d724a45b3a0aa898e82888f"
format_stamp: "Formatted at 2026-08-06 16:57:29 on dist-test-slave-cbsf"
server_key: "01d2af54da346715e282bde42f4aad4f"
server_key_iv: "18ce905beec0045246c3948a4e7ac758"
server_key_version: "encryptionkey@0"
I20260806 16:57:29.414676 14056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "f77d18725d724a45b3a0aa898e82888f"
format_stamp: "Formatted at 2026-08-06 16:57:29 on dist-test-slave-cbsf"
server_key: "01d2af54da346715e282bde42f4aad4f"
server_key_iv: "18ce905beec0045246c3948a4e7ac758"
server_key_version: "encryptionkey@0"
I20260806 16:57:29.418867 14056 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:29.421590 14071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:29.422947 14056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 16:57:29.423096 14056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "f77d18725d724a45b3a0aa898e82888f"
format_stamp: "Formatted at 2026-08-06 16:57:29 on dist-test-slave-cbsf"
server_key: "01d2af54da346715e282bde42f4aad4f"
server_key_iv: "18ce905beec0045246c3948a4e7ac758"
server_key_version: "encryptionkey@0"
I20260806 16:57:29.423224 14056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:29.436856 14056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:29.440497 14056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:29.440796 14056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:29.441434 14056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:29.442364 14056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:29.442438 14056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:29.442541 14056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:29.442592 14056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:29.451854 14056 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:41881
I20260806 16:57:29.451929 14195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:41881 every 8 connection(s)
I20260806 16:57:29.452986 14056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:29.455312 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14056
I20260806 16:57:29.455469 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:29.455852 7780 external_mini_cluster.cc:1428] Setting key 2bf8857ef01e4d3fc8a897ce05608765
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:29.469089 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.455756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:57557 (local address 127.7.153.62:42295)
0806 16:57:29.455961 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.455966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.457204 (+ 1238us) server_negotiation.cc:407] Connection header received
0806 16:57:29.458948 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.458951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.459010 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.459095 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.460482 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.461048 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.462259 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.462475 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.462557 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.465429 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:29.465433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:29.465435 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:29.465463 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:29.466909 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.467469 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.467472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.467473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.467552 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.467863 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.467865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.467866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.468060 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:29.468145 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:29.468750 (+ 605us) server_negotiation.cc:299] Negotiation successful
0806 16:57:29.468899 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260806 16:57:29.470233 14198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.456327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42295 (local address 127.7.153.3:57557)
0806 16:57:29.457032 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:29.457091 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:29.458731 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:29.459270 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:29.459278 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:29.459703 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:29.460336 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:29.460352 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.461181 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.461185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:29.462139 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:29.462149 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.462633 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.462635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:29.462790 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.463503 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:29.463521 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:29.465225 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:29.467045 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:29.467052 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:29.467075 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:29.467373 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:29.467634 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:29.467637 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:29.467638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:29.467780 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:29.468149 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:29.468155 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:29.468428 (+ 273us) client_negotiation.cc:769] Sending connection context
0806 16:57:29.468608 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 16:57:29.469043 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":196,"threads_started":1}
I20260806 16:57:29.471436 14196 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42295
I20260806 16:57:29.471720 14196 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:29.472316 14196 heartbeater.cc:511] Master 127.7.153.62:42295 requested a full tablet report, sending...
I20260806 16:57:29.473568 13701 ts_manager.cc:194] Registered new tserver with Master: f77d18725d724a45b3a0aa898e82888f (127.7.153.3:41881)
I20260806 16:57:29.474212 13701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:57557
I20260806 16:57:29.482630 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/test-admin.keytab.
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.502569 7780 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 16:57:29.506134 14203 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:29.504343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49794 (local address 127.7.153.1:41253)
0806 16:57:29.504828 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.504834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.504864 (+ 30us) server_negotiation.cc:407] Connection header received
0806 16:57:29.504931 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.504937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.505142 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.505279 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.505925 (+ 646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49794: BlockingRecv error: recv got EOF from 127.0.0.1:49794 (error 108)
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":79,"threads_started":1}
W20260806 16:57:29.506191 7780 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc' of type FILE
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.507449 7780 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.508533 7780 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:29.519797 14203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.509723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.7.153.1:41253)
0806 16:57:29.509873 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.509877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.509893 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:29.510064 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.510067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.510126 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.510203 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.510806 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.511628 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.512518 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.513035 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.513141 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.515711 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:29.515724 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:29.515742 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:29.515774 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:29.517742 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.518320 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.518326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.518327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.518423 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.518769 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.518773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.518774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.519057 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:29.519253 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:29.519515 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 16:57:29.519667 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 16:57:29.524997 14203 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:29.523731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49812 (local address 127.7.153.1:41253)
0806 16:57:29.523878 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.523883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.523978 (+ 95us) server_negotiation.cc:407] Connection header received
0806 16:57:29.524146 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.524149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.524199 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.524290 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.524846 (+ 556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49812: BlockingRecv error: recv got EOF from 127.0.0.1:49812 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 16:57:29.525177 7780 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc' of type FILE
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.526351 7780 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.527757 7780 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:29.538508 14203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.529096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49826 (local address 127.7.153.1:41253)
0806 16:57:29.529309 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.529314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.529493 (+ 179us) server_negotiation.cc:407] Connection header received
0806 16:57:29.529682 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.529685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.529729 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.529816 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.530484 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.531039 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.531879 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.532121 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.532237 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.534981 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:29.534985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:29.534988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:29.535028 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:29.536606 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.537173 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.537177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.537179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.537271 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.537562 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.537566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.537568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.537789 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:29.537965 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:29.538211 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 16:57:29.538334 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 16:57:29.541568 14203 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:29.540558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49838 (local address 127.7.153.1:41253)
0806 16:57:29.540828 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.540832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.540846 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:57:29.540919 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.540921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.540958 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.541034 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.541441 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49838: BlockingRecv error: recv got EOF from 127.0.0.1:49838 (error 108)
Metrics: {"server-negotiator.queue_time_us":177}
W20260806 16:57:29.541646 7780 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786035416626244-7780-0/krb5kdc/krb5cc' of type FILE
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.542835 7780 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:29.543817 7780 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[13653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 16:57:29.555019 14203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:29.545011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49854 (local address 127.7.153.1:41253)
0806 16:57:29.545149 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:29.545153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:29.545170 (+ 17us) server_negotiation.cc:407] Connection header received
0806 16:57:29.545314 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:29.545317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:29.545357 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:29.545430 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:29.546009 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.546711 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.547584 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:29.547826 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:29.547921 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:29.551067 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:29.551071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:29.551074 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:29.551105 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:29.552881 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.553470 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.553474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.553476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.553571 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:29.553886 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:29.553890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:29.553892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:29.554096 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:29.554277 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:29.554504 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 16:57:29.554721 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 16:57:29.556177 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13766
I20260806 16:57:29.564872 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13909
I20260806 16:57:29.573443 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14056
I20260806 16:57:29.582242 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 13667
2026-08-06T16:57:29Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2396 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[14217](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[14217](info): set up 2 sockets
Aug 06 16:57:29 dist-test-slave-cbsf krb5kdc[14217](info): commencing operation
krb5kdc: starting...
W20260806 16:57:30.685891 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:30 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab.
Entry for principal oryx/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab.
I20260806 16:57:30.828442 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:33283
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab
--principal=oryx/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:33283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:30.953030 14232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:30.953359 14232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:30.953403 14232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:30.957814 14232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:30.957896 14232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:30.957917 14232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:30.957935 14232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:30.957952 14232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:30.963879 14232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:33283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab
--principal=oryx/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:33283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:30.965179 14232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:30.966248 14232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:30.976811 14243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:30.976799 14240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:30.976799 14239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:30.976933 14232 server_base.cc:1034] running on GCE node
I20260806 16:57:30.977892 14232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:30.979174 14232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:30.980383 14232 hybrid_clock.cc:648] HybridClock initialized: now 1786035450980348 us; error 52 us; skew 500 ppm
Aug 06 16:57:30 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:30.984133 14232 init.cc:377] Logged in from keytab as oryx/127.7.153.62@KRBTEST.COM (short username oryx)
I20260806 16:57:30.985320 14232 webserver.cc:460] Webserver started at http://127.7.153.62:37293/ using document root <none> and password file <none>
I20260806 16:57:30.986101 14232 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:30.986191 14232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:30.986508 14232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:30.989053 14232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "e840087cb4a34383841d440dc1125d60"
format_stamp: "Formatted at 2026-08-06 16:57:30 on dist-test-slave-cbsf"
server_key: "8751e30803dfa26e33398ca07a7025c2"
server_key_iv: "93a7a1fb8935778193e6d484bd6be1f1"
server_key_version: "encryptionkey@0"
I20260806 16:57:30.989787 14232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "e840087cb4a34383841d440dc1125d60"
format_stamp: "Formatted at 2026-08-06 16:57:30 on dist-test-slave-cbsf"
server_key: "8751e30803dfa26e33398ca07a7025c2"
server_key_iv: "93a7a1fb8935778193e6d484bd6be1f1"
server_key_version: "encryptionkey@0"
I20260806 16:57:30.995704 14232 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 16:57:30.999773 14250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.001447 14232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:31.001634 14232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "e840087cb4a34383841d440dc1125d60"
format_stamp: "Formatted at 2026-08-06 16:57:30 on dist-test-slave-cbsf"
server_key: "8751e30803dfa26e33398ca07a7025c2"
server_key_iv: "93a7a1fb8935778193e6d484bd6be1f1"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.001786 14232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:31.024437 14232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:31.027637 14232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:31.027865 14232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:31.035446 14232 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:33283
I20260806 16:57:31.035760 14304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:33283 every 8 connection(s)
I20260806 16:57:31.036594 14232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:31.038717 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14232
I20260806 16:57:31.038861 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:31.039204 7780 external_mini_cluster.cc:1428] Setting key ad7bc92229f588441913a68a505a0fe8
I20260806 16:57:31.040270 14305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:31.046571 14305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Bootstrap starting.
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:31.049456 14305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:31.050401 14305 log.cc:824] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:31.052802 14305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: No bootstrap required, opened a new log
I20260806 16:57:31.055038 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.040799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52932 (local address 127.7.153.62:33283)
0806 16:57:31.041274 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:31.041290 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:31.041329 (+ 39us) server_negotiation.cc:407] Connection header received
0806 16:57:31.042015 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:31.042032 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:31.042389 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:31.042771 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:31.043691 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.044785 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.045677 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.046201 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.046380 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.049596 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:31.049605 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:31.049628 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:31.049677 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:31.051798 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.052346 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.052351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.052357 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.052478 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.052833 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.052838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.052841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.053367 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:31.053594 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:31.053921 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 16:57:31.054255 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":137,"threads_started":1}
I20260806 16:57:31.056766 14305 raft_consensus.cc:348] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } }
I20260806 16:57:31.057044 14305 raft_consensus.cc:374] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:31.057130 14305 raft_consensus.cc:729] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e840087cb4a34383841d440dc1125d60, State: Initialized, Role: FOLLOWER
I20260806 16:57:31.057713 14305 consensus_queue.cc:260] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } }
I20260806 16:57:31.057900 14305 raft_consensus.cc:388] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:31.057974 14305 raft_consensus.cc:482] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:31.058079 14305 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:31.059168 14305 raft_consensus.cc:504] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } }
I20260806 16:57:31.059552 14305 leader_election.cc:302] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e840087cb4a34383841d440dc1125d60; no voters:
I20260806 16:57:31.059968 14305 leader_election.cc:288] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:31.060149 14310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:31.060406 14310 raft_consensus.cc:686] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 LEADER]: Becoming Leader. State: Replica: e840087cb4a34383841d440dc1125d60, State: Running, Role: LEADER
I20260806 16:57:31.060822 14310 consensus_queue.cc:237] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } }
I20260806 16:57:31.061513 14305 sys_catalog.cc:564] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:31.062824 14312 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e840087cb4a34383841d440dc1125d60. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } }
I20260806 16:57:31.062963 14312 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:31.063359 14321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:31.063329 14311 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } }
I20260806 16:57:31.064174 14311 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:31.066982 14321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:31.073462 14321 catalog_manager.cc:1347] Generated new cluster ID: 8290c0a657214072b7e48e8b83f452f5
I20260806 16:57:31.073554 14321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:31.096148 14321 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:31.097677 14321 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:31.105870 14321 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Generated new TSK 0
I20260806 16:57:31.106886 14321 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab.
Entry for principal oryx/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab.
I20260806 16:57:31.146029 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33283
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:31.275280 14333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:31.275597 14333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:31.275645 14333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:31.279937 14333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:31.280022 14333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:31.280087 14333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:31.285854 14333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:31.287123 14333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:31.288241 14333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:31.298873 14339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:31.298873 14341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:31.298862 14338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:31.299172 14333 server_base.cc:1034] running on GCE node
I20260806 16:57:31.299747 14333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:31.300601 14333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:31.301813 14333 hybrid_clock.cc:648] HybridClock initialized: now 1786035451301776 us; error 53 us; skew 500 ppm
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035451, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:31.305087 14333 init.cc:377] Logged in from keytab as oryx/127.7.153.1@KRBTEST.COM (short username oryx)
I20260806 16:57:31.306201 14333 webserver.cc:460] Webserver started at http://127.7.153.1:35343/ using document root <none> and password file <none>
I20260806 16:57:31.306910 14333 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:31.307014 14333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:31.307297 14333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:31.309820 14333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "b9bc767af21e4a588f5e63ff0ee55503"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "e96935f787f7897edc8b74f424063d0b"
server_key_iv: "38d33734f1be88da74cb41af113ac7b4"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.310488 14333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "b9bc767af21e4a588f5e63ff0ee55503"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "e96935f787f7897edc8b74f424063d0b"
server_key_iv: "38d33734f1be88da74cb41af113ac7b4"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.314985 14333 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260806 16:57:31.317869 14349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.319234 14333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:31.319414 14333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "b9bc767af21e4a588f5e63ff0ee55503"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "e96935f787f7897edc8b74f424063d0b"
server_key_iv: "38d33734f1be88da74cb41af113ac7b4"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.319553 14333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:31.341821 14333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:31.345682 14333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:31.345920 14333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:31.346582 14333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:31.347493 14333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:31.347565 14333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.347640 14333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:31.347681 14333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.357205 14333 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:46753
I20260806 16:57:31.357249 14473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:46753 every 8 connection(s)
I20260806 16:57:31.358245 14333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:31.365067 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14333
I20260806 16:57:31.365244 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:31.365670 7780 external_mini_cluster.cc:1428] Setting key c3431fddaddda354f6a15ede0e2c1721
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035451, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:31.375519 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.360281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:52311 (local address 127.7.153.62:33283)
0806 16:57:31.360498 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:31.360501 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:31.361440 (+ 939us) server_negotiation.cc:407] Connection header received
0806 16:57:31.362981 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:31.362984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:31.363050 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:31.363141 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:31.364501 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.365178 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.366877 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.367231 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.367355 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.370728 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:31.370753 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:31.370757 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:31.370819 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:31.372816 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.373458 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.373462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.373464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.373559 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.374018 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.374025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.374030 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.374341 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:31.374475 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:31.375058 (+ 583us) server_negotiation.cc:299] Negotiation successful
0806 16:57:31.375255 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 16:57:31.376259 14476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.360668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:52311)
0806 16:57:31.361285 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:31.361331 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:31.362760 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:31.363318 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:31.363326 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:31.363817 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:31.364341 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:31.364355 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.365356 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.365361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:31.366734 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:31.366746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.367456 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.367461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:31.367692 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.368370 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:31.368399 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:31.370429 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:31.372975 (+ 2546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:31.372984 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:31.373007 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:31.373335 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:31.373663 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:31.373666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:31.373668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:31.373890 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:31.374477 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:31.374483 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:31.374782 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 16:57:31.374962 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 16:57:31.375273 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":121,"threads_started":1}
I20260806 16:57:31.377760 14474 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33283
I20260806 16:57:31.378075 14474 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:31.378813 14474 heartbeater.cc:511] Master 127.7.153.62:33283 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:57:31.380798 14268 ts_manager.cc:194] Registered new tserver with Master: b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:31.382305 14268 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:52311
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab.
Entry for principal oryx/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab.
I20260806 16:57:31.398228 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33283
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:31.523730 14479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:31.524093 14479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:31.524197 14479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:31.528609 14479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:31.528779 14479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:31.528903 14479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:31.534777 14479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:31.536068 14479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:31.537253 14479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:31.548012 14487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:31.548079 14479 server_base.cc:1034] running on GCE node
W20260806 16:57:31.548000 14484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:31.548007 14485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:31.548789 14479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:31.549476 14479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:31.550652 14479 hybrid_clock.cc:648] HybridClock initialized: now 1786035451550630 us; error 36 us; skew 500 ppm
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035451, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:31.553676 14479 init.cc:377] Logged in from keytab as oryx/127.7.153.2@KRBTEST.COM (short username oryx)
I20260806 16:57:31.554701 14479 webserver.cc:460] Webserver started at http://127.7.153.2:44657/ using document root <none> and password file <none>
I20260806 16:57:31.555279 14479 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:31.555343 14479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:31.555526 14479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:31.558151 14479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "658879b124224d9994ce699b7a3a8189"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "71debabe7869bb6a53c2e048f94509c5"
server_key_iv: "53de7df5108b03571ecaa764138f0d5d"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.558844 14479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "658879b124224d9994ce699b7a3a8189"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "71debabe7869bb6a53c2e048f94509c5"
server_key_iv: "53de7df5108b03571ecaa764138f0d5d"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.563289 14479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:31.566097 14494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.567600 14479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:57:31.567730 14479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "658879b124224d9994ce699b7a3a8189"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "71debabe7869bb6a53c2e048f94509c5"
server_key_iv: "53de7df5108b03571ecaa764138f0d5d"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.567840 14479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:31.598078 14479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:31.601245 14479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:31.601425 14479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:31.602016 14479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:31.602890 14479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:31.602937 14479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.602980 14479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:31.602996 14479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.613588 14479 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34463
I20260806 16:57:31.613655 14616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34463 every 8 connection(s)
I20260806 16:57:31.614696 14479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:31.617398 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14479
I20260806 16:57:31.617547 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:31.617856 7780 external_mini_cluster.cc:1428] Setting key 5bf490945243914079e8ca62d36f23ef
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035451, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:57:31.632856 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.616967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:43985 (local address 127.7.153.62:33283)
0806 16:57:31.617171 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:31.617177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:31.618831 (+ 1654us) server_negotiation.cc:407] Connection header received
0806 16:57:31.620116 (+ 1285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:31.620118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:31.620166 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:31.620250 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:31.622237 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.623125 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.624721 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.624984 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.625086 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.628662 (+ 3576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:31.628666 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:31.628668 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:31.628749 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:31.630335 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.630958 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.630963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.630965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.631059 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.631443 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.631447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.631449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.631679 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:31.631797 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:31.632480 (+ 683us) server_negotiation.cc:299] Negotiation successful
0806 16:57:31.632643 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 16:57:31.633903 14619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.617419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:43985)
0806 16:57:31.618633 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:31.618706 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:31.619833 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:31.620489 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:31.620504 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:31.621161 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:31.621996 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:31.622023 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.623297 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.623299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:31.624494 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:31.624506 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.625188 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.625196 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:31.625478 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.626295 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:31.626330 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:31.628412 (+ 2082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:31.630490 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:31.630498 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:31.630520 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:31.630838 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:31.631163 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:31.631166 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:31.631168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:31.631336 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:31.631799 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:31.631809 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:31.632173 (+ 364us) client_negotiation.cc:769] Sending connection context
0806 16:57:31.632431 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 16:57:31.632862 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"thread_start_us":670,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:31.635399 14617 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33283
I20260806 16:57:31.635754 14617 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:31.636438 14617 heartbeater.cc:511] Master 127.7.153.62:33283 requested a full tablet report, sending...
I20260806 16:57:31.637887 14268 ts_manager.cc:194] Registered new tserver with Master: 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463)
I20260806 16:57:31.638563 14268 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:43985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab.
Entry for principal oryx/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab.
I20260806 16:57:31.652491 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33283
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:31.779244 14622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:31.779613 14622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:31.779666 14622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:31.784148 14622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:31.784250 14622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:31.784360 14622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:31.790336 14622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:31.791611 14622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:31.793102 14622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:31.803846 14627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:31.803997 14622 server_base.cc:1034] running on GCE node
W20260806 16:57:31.803889 14628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:31.803898 14630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:31.804746 14622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:31.805663 14622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:31.806880 14622 hybrid_clock.cc:648] HybridClock initialized: now 1786035451806854 us; error 35 us; skew 500 ppm
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035451, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:31.810032 14622 init.cc:377] Logged in from keytab as oryx/127.7.153.3@KRBTEST.COM (short username oryx)
I20260806 16:57:31.811105 14622 webserver.cc:460] Webserver started at http://127.7.153.3:33283/ using document root <none> and password file <none>
I20260806 16:57:31.811720 14622 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:31.811815 14622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:31.812071 14622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:31.814780 14622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "083e7294b8f24867a8f614cfae4fd209"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "313ed0592d888b2668c35c77cb8e9abb"
server_key_iv: "819387b14cb08c0355d000a1ca7684d6"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.815433 14622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "083e7294b8f24867a8f614cfae4fd209"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "313ed0592d888b2668c35c77cb8e9abb"
server_key_iv: "819387b14cb08c0355d000a1ca7684d6"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.819718 14622 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 16:57:31.822650 14637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.824127 14622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:31.824290 14622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "083e7294b8f24867a8f614cfae4fd209"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "313ed0592d888b2668c35c77cb8e9abb"
server_key_iv: "819387b14cb08c0355d000a1ca7684d6"
server_key_version: "encryptionkey@0"
I20260806 16:57:31.824437 14622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:31.868324 14622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:31.871773 14622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:31.871996 14622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:31.872723 14622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:31.873636 14622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:31.873710 14622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.873786 14622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:31.873831 14622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:31.883436 14622 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:41341
I20260806 16:57:31.883461 14760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:41341 every 8 connection(s)
I20260806 16:57:31.884442 14622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:31.892104 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14622
I20260806 16:57:31.892258 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:31.892598 7780 external_mini_cluster.cc:1428] Setting key 1b14fa7307a2a10c42e9765de1a4b091
Aug 06 16:57:31 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035451, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:31.899261 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.886412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:35455 (local address 127.7.153.62:33283)
0806 16:57:31.886560 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:31.886564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:31.887365 (+ 801us) server_negotiation.cc:407] Connection header received
0806 16:57:31.888595 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:31.888597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:31.888649 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:31.888797 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:31.890017 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.890567 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.891750 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.892013 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.892115 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.895574 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:31.895578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:31.895580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:31.895608 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:31.897075 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.897643 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.897645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.897647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.897728 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:31.898139 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:31.898141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:31.898143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:31.898377 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:31.898460 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:31.899014 (+ 554us) server_negotiation.cc:299] Negotiation successful
0806 16:57:31.899132 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 16:57:31.900233 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:31.886738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:35455)
0806 16:57:31.887198 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:31.887241 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:31.888382 (+ 1141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:31.888947 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:31.888954 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:31.889330 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:31.889846 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:31.889859 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.890685 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.890687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:31.891601 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:31.891619 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:31.892234 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:31.892240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:31.892469 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:31.893374 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:31.893395 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:31.895401 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:31.897224 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:31.897230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:31.897248 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:31.897550 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:31.897841 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:31.897844 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:31.897845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:31.898019 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:31.898476 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:31.898481 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:31.898780 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 16:57:31.898956 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 16:57:31.899261 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":117,"threads_started":1}
I20260806 16:57:31.901593 14761 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33283
I20260806 16:57:31.901868 14761 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:31.902432 14761 heartbeater.cc:511] Master 127.7.153.62:33283 requested a full tablet report, sending...
I20260806 16:57:31.903597 14268 ts_manager.cc:194] Registered new tserver with Master: 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341)
I20260806 16:57:31.904213 14268 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:35455
I20260806 16:57:31.907127 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.153.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.61.keytab.
Entry for principal oryx/127.7.153.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.61.keytab.
I20260806 16:57:31.939992 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:41475
--webserver_interface=127.7.153.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.61.keytab
--principal=oryx/127.7.153.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:33283,127.7.153.61:41475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:32.042689 14300 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.7.153.62:33283
W20260806 16:57:32.068377 14766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:32.068732 14766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:32.068776 14766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:32.073243 14766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:32.073326 14766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:32.073347 14766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:32.073365 14766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:32.073381 14766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:32.079341 14766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:33283,127.7.153.61:41475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.61.keytab
--principal=oryx/127.7.153.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:41475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.153.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
W20260806 16:57:32.079638 14766 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.7.153.62:33283,127.7.153.61:41475'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 16:57:32.080856 14766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:32.082430 14766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:57:32.092420 14766 server_base.cc:1034] running on GCE node
W20260806 16:57:32.092357 14776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:32.092432 14773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:32.092345 14772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.093321 14766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:32.094686 14766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:32.095937 14766 hybrid_clock.cc:648] HybridClock initialized: now 1786035452095900 us; error 59 us; skew 500 ppm
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:32.100867 14766 init.cc:377] Logged in from keytab as oryx/127.7.153.61@KRBTEST.COM (short username oryx)
I20260806 16:57:32.102030 14766 webserver.cc:460] Webserver started at http://127.7.153.61:35383/ using document root <none> and password file <none>
I20260806 16:57:32.102696 14766 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.102802 14766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.103066 14766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:32.105537 14766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/instance:
uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "b4ff77c83dcf72235c8b4885d4753afb"
server_key_iv: "ebe92b780035fba25e51f01589f18f53"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.106302 14766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal/instance:
uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "b4ff77c83dcf72235c8b4885d4753afb"
server_key_iv: "ebe92b780035fba25e51f01589f18f53"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.111572 14766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 16:57:32.114698 14783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.116544 14766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:32.116745 14766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "b4ff77c83dcf72235c8b4885d4753afb"
server_key_iv: "ebe92b780035fba25e51f01589f18f53"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.117115 14766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.142290 14766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:32.146243 14766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:32.146488 14766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:32.155167 14766 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.61:41475
I20260806 16:57:32.155474 14838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.61:41475 every 8 connection(s)
I20260806 16:57:32.156522 14766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
I20260806 16:57:32.159636 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14766
I20260806 16:57:32.159827 14839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:32.165736 14839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.61@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:32.179036 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.161936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57574 (local address 127.7.153.61:41475)
0806 16:57:32.162452 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.162473 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.162611 (+ 138us) server_negotiation.cc:407] Connection header received
0806 16:57:32.163843 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.163872 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.164363 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.164827 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.165733 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.167225 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.168358 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.169040 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.169178 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.172928 (+ 3750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.172939 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.172963 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.173011 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.175347 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.176076 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.176084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.176092 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.176250 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.176618 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.176623 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.176624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.177246 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.177500 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.177809 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.178175 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":156,"threads_started":1}
I20260806 16:57:32.180516 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.168018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.7.153.62:33283)
0806 16:57:32.168196 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.168201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.168591 (+ 390us) server_negotiation.cc:407] Connection header received
0806 16:57:32.168827 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.168831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.168889 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.168982 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.169971 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.170516 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.171820 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.172170 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.172311 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.176275 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.176279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.176281 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.176314 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.178097 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.178622 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.178625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.178627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.178718 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.179012 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.179017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.179019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.179607 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.179781 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.180275 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.180398 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 16:57:32.180687 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.167947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:52934)
0806 16:57:32.168450 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.168497 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.168674 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.169041 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.169048 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.169627 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.169818 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.169830 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.170690 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.170697 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.171660 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.171673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.172476 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.172481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.172646 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.173790 (+ 1144us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.173809 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.176088 (+ 2279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.178227 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.178241 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.178248 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.178498 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.178819 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.178822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.178824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.178916 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.179781 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.179791 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.179964 (+ 173us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.180169 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.180493 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":159,"threads_started":1}
I20260806 16:57:32.182209 14839 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.61@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
I20260806 16:57:32.192322 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.182817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57578)
0806 16:57:32.183088 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.183109 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.183270 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.183696 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.183698 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.183891 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.184454 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.184462 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.185320 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.185325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.185836 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.185843 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.186326 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.186329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.186437 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.187016 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.187027 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.188450 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.190247 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.190250 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.190251 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.190475 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.190901 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.190906 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.190908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.191079 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.191782 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.191785 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.191911 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.192022 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.192156 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260806 16:57:32.192596 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.182878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.7.153.61:41475)
0806 16:57:32.183088 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.183094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.183195 (+ 101us) server_negotiation.cc:407] Connection header received
0806 16:57:32.183519 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.183524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.183586 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.183683 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.184580 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.185209 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.185956 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.186209 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.186321 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.188608 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.188611 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.188613 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.188639 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.190098 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.190595 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.190598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.190599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.190679 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.191367 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.191371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.191373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.191640 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.191751 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.192150 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.192283 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 16:57:32.197033 14839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Bootstrap starting.
I20260806 16:57:32.200140 14839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:32.201090 14839 log.cc:824] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:32.203464 14839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: No bootstrap required, opened a new log
I20260806 16:57:32.207219 14839 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } }
I20260806 16:57:32.207513 14839 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:32.207556 14839 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a85c7ac4874212806f83efbd0dd8e6, State: Initialized, Role: FOLLOWER
I20260806 16:57:32.208001 14839 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } }
I20260806 16:57:32.208637 14846 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } } }
I20260806 16:57:32.208971 14846 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:32.209640 14839 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 16:57:32.215428 14857 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:32.215550 14857 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:32.219471 14766 master_runner.cc:428] Detected that this master b1a85c7ac4874212806f83efbd0dd8e6 is joining an existing cluster
I20260806 16:57:32.219599 14766 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.153.61:41475
I20260806 16:57:32.231701 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.222801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.7.153.61:41475)
0806 16:57:32.222921 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.222927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.223144 (+ 217us) server_negotiation.cc:407] Connection header received
0806 16:57:32.223274 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.223279 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.223328 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.223424 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.224040 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.224873 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.226094 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.226410 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.226503 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.228093 (+ 1590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.228103 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.228106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.228125 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.229829 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.230305 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.230308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.230310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.230391 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.230694 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.230699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.230704 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.230941 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.231034 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.231381 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.231515 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":47}
I20260806 16:57:32.232266 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.222296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52944 (local address 127.7.153.62:33283)
0806 16:57:32.222453 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.222458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.222759 (+ 301us) server_negotiation.cc:407] Connection header received
0806 16:57:32.222995 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.222998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.223051 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.223097 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.223989 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.224873 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.225963 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.226329 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.226457 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.228357 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.228362 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.228365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.228400 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.230145 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.230645 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.230650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.230653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.230745 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.231049 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.231056 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.231060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.231294 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.231392 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.231683 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.232125 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 16:57:32.232432 14864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.222135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:52944)
0806 16:57:32.222629 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.222671 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.222847 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.223363 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.223368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.223696 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.223856 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.223863 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.225006 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.225009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.225807 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.225818 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.226473 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.226477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.226626 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.227757 (+ 1131us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.227772 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.228197 (+ 425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.230267 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.230270 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.230273 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.230536 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.230847 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.230850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.230852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.230943 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.231391 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.231394 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.231488 (+ 94us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.231605 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.231758 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":168,"thread_start_us":185,"threads_started":1}
I20260806 16:57:32.232472 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.222696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57586)
0806 16:57:32.223034 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.223048 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.223171 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.223465 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.223468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.223732 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.223936 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.223944 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.225003 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.225006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.225970 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.225982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.226637 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.226641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.226723 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.227431 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.227445 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.227951 (+ 506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.229959 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.229962 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.229964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.230220 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.230482 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.230487 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.230489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.230575 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.231095 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.231100 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.231205 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.231955 (+ 750us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.232099 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":25,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for oryx/127.7.153.60@KRBTEST.COM; defaulting to no policy
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.62@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.60@KRBTEST.COM" created.
I20260806 16:57:32.249727 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.238114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57590 (local address 127.7.153.61:41475)
0806 16:57:32.238274 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.238279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.238714 (+ 435us) server_negotiation.cc:407] Connection header received
0806 16:57:32.238922 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.238927 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.238998 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.239087 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.239955 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.240901 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.242237 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.242662 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.242791 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.245744 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.245748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.245751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.245777 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.247434 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.248026 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.248030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.248032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.248121 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.248479 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.248485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.248489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.248875 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.248962 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.249406 (+ 444us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.249537 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 16:57:32.249760 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.238090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57590)
0806 16:57:32.238560 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.238620 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.238772 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.239144 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.239151 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.239644 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.239815 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.239823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.241036 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.241040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.242090 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.242103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.242807 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.242811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.242942 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.243655 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.243671 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.245556 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.247558 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.247573 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.247583 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.247903 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.248237 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.248241 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.248243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.248347 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.249042 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.249056 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.249184 (+ 128us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.249350 (+ 166us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.249585 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":137,"threads_started":1}
I20260806 16:57:32.253135 14268 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.153.61:41475: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
member_type: NON_VOTER
last_known_addr {
host: "127.7.153.61"
port: 41475
}
attrs {
promote: true
}
}
dest_uuid: "e840087cb4a34383841d440dc1125d60"
cas_config_opid_index: -1
I20260806 16:57:32.253929 14268 consensus_queue.cc:237] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } }
I20260806 16:57:32.256425 14871 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER b1a85c7ac4874212806f83efbd0dd8e6 (127.7.153.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } }
I20260806 16:57:32.257092 14811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:32.258414 14871 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.153.61:41475
I20260806 16:57:32.258985 14766 master.cc:537] Master@127.7.153.61:41475 shutting down...
I20260806 16:57:32.258983 14811 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Refusing update from remote peer e840087cb4a34383841d440dc1125d60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 16:57:32.260571 14871 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:32.260969 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } }
I20260806 16:57:32.261545 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:32.264154 14766 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260806 16:57:32.264372 14254 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260806 16:57:32.264642 14766 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:32.264810 14766 tablet_replica.cc:330] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: stopping tablet replica
W20260806 16:57:32.265652 14254 consensus_peers.cc:487] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 -> Peer b1a85c7ac4874212806f83efbd0dd8e6 (127.7.153.61:41475): Couldn't send request to peer b1a85c7ac4874212806f83efbd0dd8e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.60.keytab.
Entry for principal oryx/127.7.153.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.60.keytab.
I20260806 16:57:32.270416 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:42445
--webserver_interface=127.7.153.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.60.keytab
--principal=oryx/127.7.153.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:57:32.282099 14766 master.cc:552] Master@127.7.153.61:41475 shutdown complete.
I20260806 16:57:32.282177 14766 master_runner.cc:305] Clearing existing system tablet
I20260806 16:57:32.282454 14766 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.282523 14766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.284123 14766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 16:57:32.286227 14879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.286551 14766 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.286689 14766 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 16:57:32.286733 14766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "b4ff77c83dcf72235c8b4885d4753afb"
server_key_iv: "ebe92b780035fba25e51f01589f18f53"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.289203 14766 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:32.291795 14766 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 16:57:32.291906 14766 log.cc:1196] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 16:57:32.292174 14766 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Deleting consensus metadata
I20260806 16:57:32.292537 14766 master_runner.cc:315] Copying system tablet from 127.7.153.62:33283
I20260806 16:57:32.293885 14766 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: tablet copy: Beginning tablet copy session from remote peer at address 127.7.153.62:33283
I20260806 16:57:32.303572 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.294658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52948 (local address 127.7.153.62:33283)
0806 16:57:32.294820 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.294825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.295013 (+ 188us) server_negotiation.cc:407] Connection header received
0806 16:57:32.295136 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.295139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.295195 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.295300 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.295849 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.296651 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.297937 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.298273 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.298393 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.299842 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.299846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.299849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.299878 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.301656 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.302179 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.302182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.302184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.302286 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.302601 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.302604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.302606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.302859 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.302964 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.303273 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.303406 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:57:32.303586 14885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.294536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:52948)
0806 16:57:32.294901 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.294916 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.295044 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.295340 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.295343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.295586 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.295714 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.295722 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.296804 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.296808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.297785 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.297796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.298418 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.298422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.298535 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.299154 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.299175 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.299673 (+ 498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.301786 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.301790 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.301792 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.302062 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.302392 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.302396 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.302398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.302500 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.302968 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.302971 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.303080 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.303193 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.303355 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":112,"threads_started":1}
I20260806 16:57:32.304584 14288 tablet_copy_service.cc:140] P e840087cb4a34383841d440dc1125d60: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b1a85c7ac4874212806f83efbd0dd8e6 ({username='oryx', principal='oryx/127.7.153.61@KRBTEST.COM'} at 127.0.0.1:52948)
I20260806 16:57:32.304894 14288 tablet_copy_service.cc:161] P e840087cb4a34383841d440dc1125d60: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b1a85c7ac4874212806f83efbd0dd8e6 at {username='oryx', principal='oryx/127.7.153.61@KRBTEST.COM'} at 127.0.0.1:52948: session id = b1a85c7ac4874212806f83efbd0dd8e6-00000000000000000000000000000000
I20260806 16:57:32.306830 14288 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 16:57:32.308667 14766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 16:57:32.311693 14766 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: tablet copy: Starting download of 0 data blocks...
I20260806 16:57:32.311904 14766 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: tablet copy: Starting download of 1 WAL segments...
I20260806 16:57:32.314157 14766 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 16:57:32.316762 14288 tablet_copy_service.cc:342] P e840087cb4a34383841d440dc1125d60: Request end of tablet copy session b1a85c7ac4874212806f83efbd0dd8e6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.153.61@KRBTEST.COM'} at 127.0.0.1:52948
I20260806 16:57:32.316929 14288 tablet_copy_service.cc:433] P e840087cb4a34383841d440dc1125d60: ending tablet copy session b1a85c7ac4874212806f83efbd0dd8e6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b1a85c7ac4874212806f83efbd0dd8e6
I20260806 16:57:32.325515 14766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:32.327520 14889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.327762 14766 server_base.cc:1034] running on GCE node
W20260806 16:57:32.327514 14886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:32.327903 14887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.328372 14766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:32.328765 14766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:32.329897 14766 hybrid_clock.cc:648] HybridClock initialized: now 1786035452329884 us; error 32 us; skew 500 ppm
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:32.331772 14766 init.cc:377] Logged in from keytab as oryx/127.7.153.61@KRBTEST.COM (short username oryx)
I20260806 16:57:32.332325 14766 webserver.cc:460] Webserver started at http://127.7.153.61:42267/ using document root <none> and password file <none>
I20260806 16:57:32.332542 14766 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.332590 14766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.334125 14766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:32.335247 14896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.335554 14766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:32.335632 14766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "b4ff77c83dcf72235c8b4885d4753afb"
server_key_iv: "ebe92b780035fba25e51f01589f18f53"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.335716 14766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.364455 14766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:32.366961 14766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:32.372605 14766 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.61:41475
I20260806 16:57:32.372665 14955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.61:41475 every 8 connection(s)
I20260806 16:57:32.373377 14766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
I20260806 16:57:32.377460 14958 sys_catalog.cc:263] Verifying existing consensus state
I20260806 16:57:32.379037 14958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Bootstrap starting.
I20260806 16:57:32.385079 14474 heartbeater.cc:503] Master 127.7.153.62:33283 was elected leader, sending a full tablet report...
I20260806 16:57:32.392299 14958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 16:57:32.392860 14958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Bootstrap complete.
I20260806 16:57:32.393610 14958 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } }
I20260806 16:57:32.393859 14958 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b1a85c7ac4874212806f83efbd0dd8e6, State: Initialized, Role: LEARNER
I20260806 16:57:32.394040 14958 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } }
I20260806 16:57:32.394599 14961 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } }
I20260806 16:57:32.394726 14961 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: LEARNER
I20260806 16:57:32.395107 14958 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:32.399971 14972 catalog_manager.cc:1259] Loaded cluster ID: 8290c0a657214072b7e48e8b83f452f5
I20260806 16:57:32.400054 14972 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: loading cluster ID for follower catalog manager: success
I20260806 16:57:32.402326 14972 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: acquiring CA information for follower catalog manager: success
I20260806 16:57:32.403855 14972 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 16:57:32.425657 14877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:32.426563 14877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:32.426726 14877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:32.431535 14877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:32.431664 14877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:32.431704 14877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:32.431744 14877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:32.431780 14877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:32.438059 14877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.60.keytab
--principal=oryx/127.7.153.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:42445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.153.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:32.439328 14877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:32.440497 14877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:32.450140 14978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.450207 14877 server_base.cc:1034] running on GCE node
W20260806 16:57:32.450176 14977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:32.450136 14980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.451030 14877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:32.452304 14877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:32.453534 14877 hybrid_clock.cc:648] HybridClock initialized: now 1786035452453467 us; error 68 us; skew 500 ppm
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:32.457042 14877 init.cc:377] Logged in from keytab as oryx/127.7.153.60@KRBTEST.COM (short username oryx)
I20260806 16:57:32.458173 14877 webserver.cc:460] Webserver started at http://127.7.153.60:43101/ using document root <none> and password file <none>
I20260806 16:57:32.458933 14877 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.459043 14877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.459291 14877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:32.462028 14877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/instance:
uuid: "dc5a89cafb174c53b18565ce89e129ad"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "4d4123ce38d05c5e9d4c265f401055f9"
server_key_iv: "598194efe1e1dada0747df9042b6c518"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.462795 14877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal/instance:
uuid: "dc5a89cafb174c53b18565ce89e129ad"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "4d4123ce38d05c5e9d4c265f401055f9"
server_key_iv: "598194efe1e1dada0747df9042b6c518"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.467581 14877 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:32.470538 14987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.472110 14877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:32.472281 14877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
uuid: "dc5a89cafb174c53b18565ce89e129ad"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "4d4123ce38d05c5e9d4c265f401055f9"
server_key_iv: "598194efe1e1dada0747df9042b6c518"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.472429 14877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.485394 14877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:32.489403 14877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:32.489635 14877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:32.499608 14877 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.60:42445
I20260806 16:57:32.499912 15046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.60:42445 every 8 connection(s)
I20260806 16:57:32.500862 14877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
I20260806 16:57:32.504222 15047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:32.509210 15047 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } has no permanent_uuid. Determining permanent_uuid...
I20260806 16:57:32.509570 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 14877
W20260806 16:57:32.512239 14304 acceptor_pool.cc:285] unable to collect diagnostics on RPC socket 127.7.153.62:33283: Invalid argument: socket address is ambiguous
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.60@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.153.60@KRBTEST.COM
I20260806 16:57:32.525259 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.512490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52950 (local address 127.7.153.62:33283)
0806 16:57:32.512614 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.512619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.512908 (+ 289us) server_negotiation.cc:407] Connection header received
0806 16:57:32.513564 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.513567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.513630 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.513757 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.514647 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.515200 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.516308 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.516547 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.516667 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.519756 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.519759 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.519761 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.519791 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.521499 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.522589 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.522592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.522593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.522693 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.523265 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.523270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.523272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.523692 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.523899 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.524889 (+ 990us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.525036 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 16:57:32.526264 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.511446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.7.153.60:42445)
0806 16:57:32.512113 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.512128 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.512165 (+ 37us) server_negotiation.cc:407] Connection header received
0806 16:57:32.513281 (+ 1116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.513307 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.513573 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.513775 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.514684 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.515572 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.516436 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.516896 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.517018 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.520135 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.520142 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.520156 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.520180 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.522945 (+ 2765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.524002 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.524012 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.524014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.524164 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.524607 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.524611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.524614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.524988 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.525212 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.525880 (+ 668us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.526014 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":140,"threads_started":1}
I20260806 16:57:32.526278 15050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.512217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:52950)
0806 16:57:32.512745 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.512802 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.513281 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.513822 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.513828 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.514209 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.514482 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.514495 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.515356 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.515359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.516165 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.516176 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.516753 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.516758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.516931 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.517628 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.517653 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.519545 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.521787 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.521810 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.521851 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.522412 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.522827 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.522831 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.522836 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.523075 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.524002 (+ 927us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.524013 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.524486 (+ 473us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.524828 (+ 342us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.525267 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":112,"threads_started":1}
I20260806 16:57:32.528842 15047 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.60@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
I20260806 16:57:32.539443 15050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.529463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57596)
0806 16:57:32.529595 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.529613 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.529694 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.530151 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.530153 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.530322 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.530429 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.530435 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.531546 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.531549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.532239 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.532251 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.532887 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.532891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.532980 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.533541 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.533563 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.535363 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.537834 (+ 2471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.537837 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.537839 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.538070 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.538382 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.538384 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.538385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.538463 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.538979 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.538982 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.539081 (+ 99us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.539174 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.539306 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 16:57:32.539573 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.529607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57596 (local address 127.7.153.61:41475)
0806 16:57:32.529934 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.529937 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.529950 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:32.529989 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.529991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.530031 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.530129 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.530559 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.531269 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.532416 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.532681 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.532869 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.535560 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.535563 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.535565 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.535593 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.537696 (+ 2103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.538203 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.538206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.538207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.538293 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.538588 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.538595 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.538596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.538850 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.538959 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.539266 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.539399 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":120,"threads_started":1}
I20260806 16:57:32.540386 15047 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.60@KRBTEST.COM for oryx/127.7.153.60@KRBTEST.COM
I20260806 16:57:32.549386 15050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.540963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.0.0.1:58088)
0806 16:57:32.541094 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.541114 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.541196 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.541417 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.541419 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.541569 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.541657 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.541662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.542891 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.542894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.543430 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.543438 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.543953 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.543956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.544015 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.544584 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.544597 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.546026 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.547608 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.547612 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.547613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.547853 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.548151 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.548154 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.548155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.548244 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.548756 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.548763 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.548876 (+ 113us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.548976 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.549221 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 16:57:32.549412 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.541039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.7.153.60:42445)
0806 16:57:32.541183 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.541189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.541206 (+ 17us) server_negotiation.cc:407] Connection header received
0806 16:57:32.541275 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.541278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.541322 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.541387 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.541787 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.542331 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.543532 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.543846 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.543932 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.546167 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.546170 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.546172 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.546194 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.547445 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.547968 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.547972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.547973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.548052 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.548348 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.548350 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.548351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.548563 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.548805 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.549063 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.549280 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":55}
I20260806 16:57:32.553197 15047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Bootstrap starting.
I20260806 16:57:32.555789 15047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:32.556646 15047 log.cc:824] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:32.558831 15047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: No bootstrap required, opened a new log
I20260806 16:57:32.562397 15047 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } }
I20260806 16:57:32.562722 15047 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:32.562805 15047 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5a89cafb174c53b18565ce89e129ad, State: Initialized, Role: FOLLOWER
I20260806 16:57:32.563282 15047 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } }
I20260806 16:57:32.563868 15053 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } } }
I20260806 16:57:32.564009 15053 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:32.564836 15047 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: configured and running, proceeding with master startup.
W20260806 16:57:32.570175 15064 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:57:32.570300 15064 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:57:32.574067 14877 master_runner.cc:428] Detected that this master dc5a89cafb174c53b18565ce89e129ad is joining an existing cluster
I20260806 16:57:32.574157 14877 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.153.60:42445
I20260806 16:57:32.581044 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14333
I20260806 16:57:32.587041 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.577832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58096 (local address 127.7.153.60:42445)
0806 16:57:32.577922 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.577925 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.578194 (+ 269us) server_negotiation.cc:407] Connection header received
0806 16:57:32.578283 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.578286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.578351 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.578429 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.579134 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.579930 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.581918 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.582152 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.582208 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.583540 (+ 1332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.583544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.583546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.583564 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.585381 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.585823 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.585826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.585828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.585897 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.586141 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.586144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.586146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.586356 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.586425 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.586736 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.586864 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":34}
I20260806 16:57:32.587541 15070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.577137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.0.0.1:58096)
0806 16:57:32.578092 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.578104 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.578202 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.578562 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.578565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.578886 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.579012 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.579020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.580055 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.580057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.581809 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.581820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.582349 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.582352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.582425 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.582961 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.582974 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.583428 (+ 454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.585493 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.585496 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.585498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.585730 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.585985 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.585987 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.585989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.586060 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.586484 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.586487 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.586567 (+ 80us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.587204 (+ 637us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.587343 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":26,"thread_start_us":78,"threads_started":1}
I20260806 16:57:32.593243 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.577698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57608 (local address 127.7.153.61:41475)
0806 16:57:32.577834 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.577838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.578489 (+ 651us) server_negotiation.cc:407] Connection header received
0806 16:57:32.578685 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.578689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.578740 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.578792 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.579365 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.580103 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.586396 (+ 6293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.586868 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.587001 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.589363 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.589367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.589370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.589402 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.591140 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.591697 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.591700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.591702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.591790 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.592106 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.592111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.592114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.592362 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.592462 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.592933 (+ 471us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.593072 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 16:57:32.593815 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.577547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57608)
0806 16:57:32.578408 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.578421 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.578551 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.578934 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.578936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.579117 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.579230 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.579237 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.580232 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.580235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.582658 (+ 2423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.582672 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.587559 (+ 4887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.587576 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.587931 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.588632 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.588653 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.589182 (+ 529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.591277 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.591283 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.591288 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.591584 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.591890 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.591896 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.591901 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.592004 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.592472 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.592478 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.592732 (+ 254us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.592866 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.593068 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":856,"thread_start_us":113,"threads_started":1}
I20260806 16:57:32.594079 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:46753
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:33283
--webserver_port=35343
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:57:32.606712 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.577097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.7.153.62:33283)
0806 16:57:32.577248 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.577253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.577975 (+ 722us) server_negotiation.cc:407] Connection header received
0806 16:57:32.578101 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.578105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.578171 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.578251 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.579004 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.579852 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.582838 (+ 2986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.583387 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.583499 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.602314 (+ 18815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.602321 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.602324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.602365 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.604328 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.604984 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.604988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.604990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.605100 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.605477 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.605481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.605483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.605793 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.605908 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.606366 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.606524 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 16:57:32.607097 15072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.577020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:52952)
0806 16:57:32.577865 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.577881 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.577999 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.578398 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.578401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.578708 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.578865 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.578877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.579987 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.579990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.582453 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.582470 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.583709 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.583716 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.583868 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.601388 (+ 17520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.601415 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.602022 (+ 607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.604505 (+ 2483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.604512 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.604515 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.604855 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.605217 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.605223 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.605229 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.605343 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.605910 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.605916 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.606091 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.606220 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.606430 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"thread_start_us":181,"threads_started":1}
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035450, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.62@KRBTEST.COM for oryx/127.7.153.60@KRBTEST.COM
I20260806 16:57:32.622716 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.611709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.0.0.1:58098)
0806 16:57:32.611913 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.611929 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.612031 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.612395 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.612398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.612664 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.612872 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.612880 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.614123 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.614127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.615106 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.615119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.615767 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.615771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.615881 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.616621 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.616638 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.618352 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.620895 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.620899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.620901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.621197 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.621556 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.621560 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.621562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.621654 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.622166 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.622169 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.622278 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.622369 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.622539 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260806 16:57:32.623442 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.611782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.7.153.60:42445)
0806 16:57:32.611902 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.611906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.611997 (+ 91us) server_negotiation.cc:407] Connection header received
0806 16:57:32.612210 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.612213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.612270 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.612347 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.613002 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.613945 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.615281 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.615635 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.618530 (+ 2895us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.618692 (+ 162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.618697 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.618702 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.618721 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.620732 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.621336 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.621340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.621341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.621446 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.621771 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.621776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.621778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.622021 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.623083 (+ 1062us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.623165 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.623295 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 16:57:32.624607 14268 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.153.60:42445: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad"
member_type: NON_VOTER
last_known_addr {
host: "127.7.153.60"
port: 42445
}
attrs {
promote: true
}
}
dest_uuid: "e840087cb4a34383841d440dc1125d60"
cas_config_opid_index: 5
I20260806 16:57:32.625296 14268 consensus_queue.cc:237] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } }
I20260806 16:57:32.626515 14871 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER dc5a89cafb174c53b18565ce89e129ad (127.7.153.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.628126 14871 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.153.60:42445
I20260806 16:57:32.628310 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.628456 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:32.629122 15015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:32.630725 15015 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Refusing update from remote peer e840087cb4a34383841d440dc1125d60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 16:57:32.631517 14873 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:32.631603 14877 master.cc:537] Master@127.7.153.60:42445 shutting down...
W20260806 16:57:32.634068 14255 consensus_peers.cc:487] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 -> Peer dc5a89cafb174c53b18565ce89e129ad (127.7.153.60:42445): Couldn't send request to peer dc5a89cafb174c53b18565ce89e129ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 16:57:32.637221 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.626643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57612)
0806 16:57:32.632401 (+ 5758us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.632421 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.632533 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.633030 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.633033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.633052 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:32.633166 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.633172 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.634227 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.634231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.635439 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.635452 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.636596 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.636600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.636726 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.636780 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.636936 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.637035 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5660}
I20260806 16:57:32.637620 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.626934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.7.153.61:41475)
0806 16:57:32.627303 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.627312 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.632639 (+ 5327us) server_negotiation.cc:407] Connection header received
0806 16:57:32.632731 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.632734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.632804 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.632889 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:32.633297 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.634086 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.635587 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.636263 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.636370 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.636526 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.637412 (+ 886us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.637505 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269}
I20260806 16:57:32.638460 14920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 LEARNER]: Refusing update from remote peer e840087cb4a34383841d440dc1125d60: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 16:57:32.639034 14873 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 16:57:32.640944 14617 heartbeater.cc:503] Master 127.7.153.62:33283 was elected leader, sending a full tablet report...
I20260806 16:57:32.641304 14920 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER dc5a89cafb174c53b18565ce89e129ad (127.7.153.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.643342 15075 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e840087cb4a34383841d440dc1125d60. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.643647 15075 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: LEARNER
I20260806 16:57:32.643360 14961 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: NON_VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: true } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.643749 14961 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: LEARNER
I20260806 16:57:32.645120 14873 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: attempting to promote NON_VOTER b1a85c7ac4874212806f83efbd0dd8e6 to VOTER
I20260806 16:57:32.645579 14877 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:32.645711 14873 consensus_queue.cc:237] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } }
I20260806 16:57:32.645886 14877 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:32.645992 14877 tablet_replica.cc:330] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: stopping tablet replica
W20260806 16:57:32.648824 14255 consensus_peers.cc:487] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 -> Peer dc5a89cafb174c53b18565ce89e129ad (127.7.153.60:42445): Couldn't send request to peer dc5a89cafb174c53b18565ce89e129ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 16:57:32.649269 14920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 LEARNER]: Refusing update from remote peer e840087cb4a34383841d440dc1125d60: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 16:57:32.649842 14871 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 16:57:32.652397 14877 master.cc:552] Master@127.7.153.60:42445 shutdown complete.
I20260806 16:57:32.652487 14877 master_runner.cc:305] Clearing existing system tablet
I20260806 16:57:32.652801 14877 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.652870 14877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.654527 14877 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:32.655277 14873 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b1a85c7ac4874212806f83efbd0dd8e6 (127.7.153.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.655977 14920 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b1a85c7ac4874212806f83efbd0dd8e6 (127.7.153.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.657531 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.657668 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:32.657773 14961 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.657884 14961 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:32.657891 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.657980 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:32.658885 15077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.659184 14877 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.659338 14877 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 16:57:32.659385 14877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
uuid: "dc5a89cafb174c53b18565ce89e129ad"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "4d4123ce38d05c5e9d4c265f401055f9"
server_key_iv: "598194efe1e1dada0747df9042b6c518"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.661939 14877 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:32.664973 14877 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 16:57:32.665100 14877 log.cc:1196] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 16:57:32.665421 14877 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Deleting consensus metadata
I20260806 16:57:32.665620 14877 master_runner.cc:315] Copying system tablet from 127.7.153.62:33283
I20260806 16:57:32.666981 14877 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: tablet copy: Beginning tablet copy session from remote peer at address 127.7.153.62:33283
I20260806 16:57:32.677062 15085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.667606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:52956)
0806 16:57:32.667931 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.667946 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.668082 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.668386 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.668389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.668628 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.668822 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.668830 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.669929 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.669933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.670863 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.670874 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.671552 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.671556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.671658 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.672270 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.672285 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.672825 (+ 540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.674993 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.674997 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.674999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.675397 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.675734 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.675739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.675743 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.675846 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.676350 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.676353 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.676469 (+ 116us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.676585 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.676839 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":100,"threads_started":1}
I20260806 16:57:32.677099 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.667743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.7.153.62:33283)
0806 16:57:32.667894 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.667899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.668042 (+ 143us) server_negotiation.cc:407] Connection header received
0806 16:57:32.668180 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.668183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.668241 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.668353 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.668957 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.669790 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.670997 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.671381 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.671515 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.672988 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.672994 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.672997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.673030 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.674866 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.675517 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.675521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.675524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.675629 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.675957 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.675963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.675965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.676234 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.676351 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.676661 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.676903 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 16:57:32.678172 14288 tablet_copy_service.cc:140] P e840087cb4a34383841d440dc1125d60: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dc5a89cafb174c53b18565ce89e129ad ({username='oryx', principal='oryx/127.7.153.60@KRBTEST.COM'} at 127.0.0.1:52956)
I20260806 16:57:32.678290 14288 tablet_copy_service.cc:161] P e840087cb4a34383841d440dc1125d60: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dc5a89cafb174c53b18565ce89e129ad at {username='oryx', principal='oryx/127.7.153.60@KRBTEST.COM'} at 127.0.0.1:52956: session id = dc5a89cafb174c53b18565ce89e129ad-00000000000000000000000000000000
I20260806 16:57:32.679438 14288 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 16:57:32.680999 14877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 16:57:32.683617 14877 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: tablet copy: Starting download of 0 data blocks...
I20260806 16:57:32.683842 14877 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: tablet copy: Starting download of 1 WAL segments...
I20260806 16:57:32.685616 14877 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 16:57:32.687704 14288 tablet_copy_service.cc:342] P e840087cb4a34383841d440dc1125d60: Request end of tablet copy session dc5a89cafb174c53b18565ce89e129ad-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.153.60@KRBTEST.COM'} at 127.0.0.1:52956
I20260806 16:57:32.687810 14288 tablet_copy_service.cc:433] P e840087cb4a34383841d440dc1125d60: ending tablet copy session dc5a89cafb174c53b18565ce89e129ad-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dc5a89cafb174c53b18565ce89e129ad
I20260806 16:57:32.696763 14877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:32.698652 15089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:32.698678 15086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.699296 14877 server_base.cc:1034] running on GCE node
W20260806 16:57:32.699429 15087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.699702 14877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:32.700042 14877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:32.701200 14877 hybrid_clock.cc:648] HybridClock initialized: now 1786035452701186 us; error 34 us; skew 500 ppm
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:32.703094 14877 init.cc:377] Logged in from keytab as oryx/127.7.153.60@KRBTEST.COM (short username oryx)
I20260806 16:57:32.703639 14877 webserver.cc:460] Webserver started at http://127.7.153.60:41491/ using document root <none> and password file <none>
I20260806 16:57:32.703835 14877 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.703877 14877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.705436 14877 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:32.706714 15097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.707029 14877 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:32.707168 14877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
uuid: "dc5a89cafb174c53b18565ce89e129ad"
format_stamp: "Formatted at 2026-08-06 16:57:32 on dist-test-slave-cbsf"
server_key: "4d4123ce38d05c5e9d4c265f401055f9"
server_key_iv: "598194efe1e1dada0747df9042b6c518"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.707326 14877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.723467 14877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:32.726258 14877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:32.732498 14877 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.60:42445
I20260806 16:57:32.732550 15155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.60:42445 every 8 connection(s)
I20260806 16:57:32.733546 14877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
I20260806 16:57:32.735941 15156 sys_catalog.cc:263] Verifying existing consensus state
I20260806 16:57:32.737275 15156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Bootstrap starting.
I20260806 16:57:32.749627 15156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 16:57:32.750008 15156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: Bootstrap complete.
I20260806 16:57:32.750722 15156 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } }
I20260806 16:57:32.750917 15156 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dc5a89cafb174c53b18565ce89e129ad, State: Initialized, Role: LEARNER
I20260806 16:57:32.751044 15156 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } }
I20260806 16:57:32.751549 15156 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:32.751473 15159 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:32.751776 15159 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: This master's current role is: LEARNER
I20260806 16:57:32.756215 15173 catalog_manager.cc:1259] Loaded cluster ID: 8290c0a657214072b7e48e8b83f452f5
I20260806 16:57:32.756299 15173 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: loading cluster ID for follower catalog manager: success
I20260806 16:57:32.758944 15173 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: acquiring CA information for follower catalog manager: success
I20260806 16:57:32.760596 15173 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 16:57:32.767591 15073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:32.767902 15073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:32.767984 15073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:32.772418 15073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:32.772504 15073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:32.772605 15073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:32.778734 15073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:46753
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=35343
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:32.780010 15073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:32.781203 15073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:32.792003 15178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:32.792002 15179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.792193 15073 server_base.cc:1034] running on GCE node
W20260806 16:57:32.791997 15181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:32.792900 15073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:32.793679 15073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:32.794890 15073 hybrid_clock.cc:648] HybridClock initialized: now 1786035452794857 us; error 61 us; skew 500 ppm
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:32.798352 15073 init.cc:377] Logged in from keytab as oryx/127.7.153.1@KRBTEST.COM (short username oryx)
I20260806 16:57:32.799415 15073 webserver.cc:460] Webserver started at http://127.7.153.1:35343/ using document root <none> and password file <none>
I20260806 16:57:32.800035 15073 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:32.800118 15073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:32.804551 15073 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:32.807143 15188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.808784 15073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:32.808977 15073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "b9bc767af21e4a588f5e63ff0ee55503"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "e96935f787f7897edc8b74f424063d0b"
server_key_iv: "38d33734f1be88da74cb41af113ac7b4"
server_key_version: "encryptionkey@0"
I20260806 16:57:32.809609 15073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:32.823339 15073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:32.827168 15073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:32.827417 15073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:32.828109 15073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:32.829272 15073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:32.829348 15073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.829416 15073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:32.829453 15073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:32.840894 15073 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:46753
I20260806 16:57:32.840947 15309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:46753 every 8 connection(s)
I20260806 16:57:32.842067 15073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:32.843910 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 15073
I20260806 16:57:32.844159 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14479
I20260806 16:57:32.856149 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:34463
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:33283
--webserver_port=44657
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
Aug 06 16:57:32 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035452, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.60@KRBTEST.COM
I20260806 16:57:32.864912 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.844281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:52325 (local address 127.7.153.62:33283)
0806 16:57:32.844427 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.844431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.848017 (+ 3586us) server_negotiation.cc:407] Connection header received
0806 16:57:32.849651 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.849655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.849722 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.849812 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.852171 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.853137 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.855025 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.855385 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.855479 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.859163 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.859170 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.859175 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.859219 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.861540 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.862358 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.862362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.862364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.862464 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.862989 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.862994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.862997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.863310 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.863388 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.864514 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.864686 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 16:57:32.865131 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.847288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:32965 (local address 127.7.153.61:41475)
0806 16:57:32.848415 (+ 1127us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.848418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.849510 (+ 1092us) server_negotiation.cc:407] Connection header received
0806 16:57:32.849995 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.850001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.850055 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.850145 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.851872 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.852727 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.854815 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.855169 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.855276 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.859617 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.859624 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.859630 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.859671 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.862557 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.863354 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.863361 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.863365 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.863471 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.863859 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.863866 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.863869 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.864150 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.864243 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.864739 (+ 496us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.864899 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1034}
I20260806 16:57:32.865202 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.845087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:55993 (local address 127.7.153.60:42445)
0806 16:57:32.847560 (+ 2473us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:32.847564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:32.850140 (+ 2576us) server_negotiation.cc:407] Connection header received
0806 16:57:32.850193 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:32.850196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:32.850253 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:32.850344 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:32.852211 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.853195 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.855674 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.856524 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.856648 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.860489 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:32.860496 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:32.860502 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:32.860543 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:32.862613 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.863310 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.863314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.863316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.863412 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:32.863761 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:32.863764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:32.863766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:32.864134 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:32.864263 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:32.864827 (+ 564us) server_negotiation.cc:299] Negotiation successful
0806 16:57:32.864998 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2388,"thread_start_us":96,"threads_started":1}
I20260806 16:57:32.867069 15314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.844793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.7.153.1:55993)
0806 16:57:32.849942 (+ 5149us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.849959 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.850050 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.850482 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.850485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.850953 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.851999 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.852009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.853351 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.853354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.855530 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.855538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.856821 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.856827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.856944 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.857523 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.857544 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.860298 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.862749 (+ 2451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.862752 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.862754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.863188 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.863515 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.863518 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.863520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.863644 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.864315 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.864318 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.864448 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.864582 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.865745 (+ 1163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5033,"mutex_wait_us":3665,"spinlock_wait_cycles":7680,"thread_start_us":155,"threads_started":1}
I20260806 16:57:32.867429 15316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.846070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.7.153.1:32965)
0806 16:57:32.849388 (+ 3318us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.849402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.849557 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.850265 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.850268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.850953 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.851707 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.851727 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.853351 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.853354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.854669 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.854681 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.855479 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.855483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.855727 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.856569 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.856614 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.859403 (+ 2789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.862731 (+ 3328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.862738 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.862742 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.863211 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.863619 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.863625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.863629 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.863739 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.864335 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.864341 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.864474 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.865364 (+ 890us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.866910 (+ 1546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3252,"mutex_wait_us":409,"spinlock_wait_cycles":19968,"thread_start_us":86,"threads_started":1}
I20260806 16:57:32.869171 15312 heartbeater.cc:347] Connected to a master server at 127.7.153.61:41475
I20260806 16:57:32.869475 15312 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:32.870249 15312 heartbeater.cc:511] Master 127.7.153.61:41475 requested a full tablet report, sending...
I20260806 16:57:32.872483 14917 ts_manager.cc:194] Registered new tserver with Master: b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753)
I20260806 16:57:32.880600 15311 heartbeater.cc:347] Connected to a master server at 127.7.153.60:42445
I20260806 16:57:32.880887 15311 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:32.881191 15311 heartbeater.cc:511] Master 127.7.153.60:42445 requested a full tablet report, sending...
I20260806 16:57:32.881162 15317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:32.844793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:52325)
0806 16:57:32.847825 (+ 3032us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:32.847877 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:32.849315 (+ 1438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:32.850172 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:32.850186 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:32.850965 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:32.851710 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.851729 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.853345 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.853351 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.854862 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:32.854877 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:32.855673 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:32.855678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:32.855787 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:32.856565 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:32.856593 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:32.858912 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:32.861703 (+ 2791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.861709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.861756 (+ 47us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.862192 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.862635 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:32.862637 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:32.862639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:32.862864 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:32.863481 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:32.863492 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:32.864134 (+ 642us) client_negotiation.cc:769] Sending connection context
0806 16:57:32.865861 (+ 1727us) client_negotiation.cc:240] Negotiation successful
0806 16:57:32.880893 (+ 15032us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2805,"mutex_wait_us":14835,"spinlock_wait_cycles":5120,"thread_start_us":161,"threads_started":1}
I20260806 16:57:32.882287 15310 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33283
I20260806 16:57:32.882398 15310 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:32.882592 15310 heartbeater.cc:511] Master 127.7.153.62:33283 requested a full tablet report, sending...
I20260806 16:57:32.882905 15116 ts_manager.cc:194] Registered new tserver with Master: b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753)
I20260806 16:57:32.883689 14268 ts_manager.cc:194] Re-registered known tserver with Master: b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753)
I20260806 16:57:32.884480 14268 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:52325
I20260806 16:57:32.906843 14761 heartbeater.cc:503] Master 127.7.153.62:33283 was elected leader, sending a full tablet report...
W20260806 16:57:32.989480 15318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:32.989826 15318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:32.989913 15318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:32.997304 15318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:32.997423 15318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:32.997532 15318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:33.005693 15318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:34463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=44657
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:33.007215 15318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:33.008518 15318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:33.019918 15325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:33.019923 15328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:33.020303 15326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:33.020292 15318 server_base.cc:1034] running on GCE node
I20260806 16:57:33.020905 15318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:33.021672 15318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:33.022902 15318 hybrid_clock.cc:648] HybridClock initialized: now 1786035453022833 us; error 100 us; skew 500 ppm
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:33.026572 15318 init.cc:377] Logged in from keytab as oryx/127.7.153.2@KRBTEST.COM (short username oryx)
I20260806 16:57:33.027734 15318 webserver.cc:460] Webserver started at http://127.7.153.2:44657/ using document root <none> and password file <none>
I20260806 16:57:33.028559 15318 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:33.028745 15318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:33.033397 15318 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260806 16:57:33.035952 15336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:33.037609 15318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:33.037786 15318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "658879b124224d9994ce699b7a3a8189"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "71debabe7869bb6a53c2e048f94509c5"
server_key_iv: "53de7df5108b03571ecaa764138f0d5d"
server_key_version: "encryptionkey@0"
I20260806 16:57:33.038410 15318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:33.054314 15318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:33.059219 15318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:33.059450 15318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:33.060312 15318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:33.061337 15318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:33.061389 15318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:33.061462 15318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:33.061492 15318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:33.072183 15318 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34463
I20260806 16:57:33.072204 15459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34463 every 8 connection(s)
I20260806 16:57:33.073472 15318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:33.076529 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 15318
I20260806 16:57:33.076757 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14622
I20260806 16:57:33.086833 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:41341
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:33283
--webserver_port=33283
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.60@KRBTEST.COM
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
I20260806 16:57:33.095885 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.077549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:59145 (local address 127.7.153.62:33283)
0806 16:57:33.077687 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.077693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.078059 (+ 366us) server_negotiation.cc:407] Connection header received
0806 16:57:33.078874 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.078877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.078939 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.078992 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.081380 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.082243 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.084765 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.085142 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.085232 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.089562 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.089569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.089574 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.089617 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.092450 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.093389 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.093396 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.093398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.093529 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.094049 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.094053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.094055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.094371 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.094480 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.095456 (+ 976us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.095650 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:33.095988 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.075710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:56199 (local address 127.7.153.61:41475)
0806 16:57:33.075974 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.075978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.076967 (+ 989us) server_negotiation.cc:407] Connection header received
0806 16:57:33.079690 (+ 2723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.079693 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.079753 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.079813 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.081380 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.082243 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.084765 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.085147 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.085232 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.090707 (+ 5475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.090714 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.090721 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.090760 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.092898 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.093748 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.093755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.093758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.093865 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.094278 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.094285 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.094287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.094576 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.094679 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.095461 (+ 782us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.095664 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260806 16:57:33.097263 15466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.077423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:59145)
0806 16:57:33.077970 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.077986 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.078753 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.079433 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.079443 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.080451 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:33.081180 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.081204 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.082474 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.082477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.084540 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.084556 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.085490 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.085494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.085852 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.086760 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:33.086787 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:33.089251 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:33.092665 (+ 3414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.092677 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.092740 (+ 63us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.093235 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.093676 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.093679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.093681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.093915 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.094562 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:33.094571 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:33.095091 (+ 520us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.096761 (+ 1670us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.096923 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":433,"spinlock_wait_cycles":25344,"thread_start_us":334,"threads_started":1}
I20260806 16:57:33.097587 15465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.076238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.7.153.2:39677)
0806 16:57:33.077580 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.077599 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.078529 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.079433 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.079443 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.080257 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:33.081195 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.081213 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.082591 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.082597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.084557 (+ 1960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.084575 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.085638 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.085645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.085864 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.086938 (+ 1074us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:33.086959 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:33.090332 (+ 3373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:33.093076 (+ 2744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.093080 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.093083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.093592 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.094101 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.094108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.094112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.094222 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.094857 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:33.094860 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:33.095091 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.095364 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.095822 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1232,"mutex_wait_us":496,"spinlock_wait_cycles":69504,"thread_start_us":149,"threads_started":1}
I20260806 16:57:33.097265 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.076232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.7.153.2:56199)
0806 16:57:33.076785 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.076843 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.078529 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.080015 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.080018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.080256 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:33.081180 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.081204 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.082474 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.082477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.084549 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.084556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.085490 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.085494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.085825 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.087313 (+ 1488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:33.087330 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:33.090523 (+ 3193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:33.093057 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.093064 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.093068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.093589 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.094018 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.094023 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.094028 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.094154 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.094753 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:33.094758 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:33.095093 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.096231 (+ 1138us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.096427 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":994,"spinlock_wait_cycles":13184,"thread_start_us":145,"threads_started":1}
I20260806 16:57:33.098644 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.075699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:39677 (local address 127.7.153.60:42445)
0806 16:57:33.075852 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.075857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.077708 (+ 1851us) server_negotiation.cc:407] Connection header received
0806 16:57:33.078813 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.078819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.078890 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.078957 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.081456 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.082389 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.084784 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.085249 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.085377 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.090581 (+ 5204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.090589 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.090592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.090635 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.092910 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.093856 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.093860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.093862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.093979 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.094341 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.094345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.094347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.094633 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.094764 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.098273 (+ 3509us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.098476 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 16:57:33.099020 15460 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33283
I20260806 16:57:33.099220 15462 heartbeater.cc:347] Connected to a master server at 127.7.153.61:41475
I20260806 16:57:33.099289 15460 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:33.099324 15462 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:33.099860 15460 heartbeater.cc:511] Master 127.7.153.62:33283 requested a full tablet report, sending...
I20260806 16:57:33.100020 15461 heartbeater.cc:347] Connected to a master server at 127.7.153.60:42445
I20260806 16:57:33.100112 15461 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:33.099876 15462 heartbeater.cc:511] Master 127.7.153.61:41475 requested a full tablet report, sending...
I20260806 16:57:33.100325 15461 heartbeater.cc:511] Master 127.7.153.60:42445 requested a full tablet report, sending...
I20260806 16:57:33.101238 14268 ts_manager.cc:194] Re-registered known tserver with Master: 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463)
I20260806 16:57:33.101656 15116 ts_manager.cc:194] Registered new tserver with Master: 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463)
I20260806 16:57:33.101686 14917 ts_manager.cc:194] Registered new tserver with Master: 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463)
I20260806 16:57:33.102118 14268 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:59145
I20260806 16:57:33.193063 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.187058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.0.0.1:58110)
0806 16:57:33.187603 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.187632 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.188176 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.188881 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.188887 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.188930 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.189115 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.189125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.190158 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.190163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.191572 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.191589 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.192508 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.192512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.192632 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.192665 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.192778 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.192886 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":144,"threads_started":1}
I20260806 16:57:33.193373 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.187373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58110 (local address 127.7.153.60:42445)
0806 16:57:33.187554 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.187557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.187862 (+ 305us) server_negotiation.cc:407] Connection header received
0806 16:57:33.188553 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.188556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.188646 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.188839 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.189367 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.189996 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.191807 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.192338 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.192462 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.192599 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.192907 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.192989 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 16:57:33.194103 15128 raft_consensus.cc:1203] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 16:57:33.194532 15159 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader e840087cb4a34383841d440dc1125d60. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:33.194730 15159 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: This master's current role is: LEARNER
W20260806 16:57:33.229211 15467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:33.229530 15467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:33.229578 15467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:33.233798 15467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:33.233882 15467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:33.233952 15467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:33.239822 15467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:41341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=33283
--tserver_master_addrs=127.7.153.62:33283,127.7.153.61:41475,127.7.153.60:42445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:33.241065 15467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:33.242143 15467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:33.253197 15474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:33.253196 15476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:33.253640 15473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:33.254073 15467 server_base.cc:1034] running on GCE node
I20260806 16:57:33.254644 15467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:33.255460 15467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:33.256657 15467 hybrid_clock.cc:648] HybridClock initialized: now 1786035453256635 us; error 37 us; skew 500 ppm
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:33.260049 15467 init.cc:377] Logged in from keytab as oryx/127.7.153.3@KRBTEST.COM (short username oryx)
I20260806 16:57:33.261478 15467 webserver.cc:460] Webserver started at http://127.7.153.3:33283/ using document root <none> and password file <none>
I20260806 16:57:33.262259 15467 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:33.262384 15467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:33.267346 15467 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 16:57:33.269896 15484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:33.271373 15467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:33.271500 15467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "083e7294b8f24867a8f614cfae4fd209"
format_stamp: "Formatted at 2026-08-06 16:57:31 on dist-test-slave-cbsf"
server_key: "313ed0592d888b2668c35c77cb8e9abb"
server_key_iv: "819387b14cb08c0355d000a1ca7684d6"
server_key_version: "encryptionkey@0"
I20260806 16:57:33.272089 15467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:33.299219 15467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:33.302855 15467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:33.303045 15467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:33.303637 15467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:33.304540 15467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:33.304589 15467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:33.304630 15467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:33.304646 15467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:33.315500 15467 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:41341
I20260806 16:57:33.315542 15612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:41341 every 8 connection(s)
I20260806 16:57:33.316648 15467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:33.317552 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 15467
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.61@KRBTEST.COM
Aug 06 16:57:33 dist-test-slave-cbsf krb5kdc[14217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035453, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.60@KRBTEST.COM
I20260806 16:57:33.334721 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.320719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57628 (local address 127.7.153.61:41475)
0806 16:57:33.320956 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.320960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.321557 (+ 597us) server_negotiation.cc:407] Connection header received
0806 16:57:33.322051 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.322054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.322108 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.322178 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.323670 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.324499 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.327332 (+ 2833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.327713 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.327805 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.330337 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.330340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.330343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.330370 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.332405 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.333047 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.333051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.333053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.333144 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.333495 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.333517 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.333519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.333757 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.333871 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.334415 (+ 544us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.334542 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":85,"threads_started":1}
I20260806 16:57:33.334719 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.320480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52960 (local address 127.7.153.62:33283)
0806 16:57:33.320646 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.320652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.321168 (+ 516us) server_negotiation.cc:407] Connection header received
0806 16:57:33.321761 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.321766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.321822 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.321881 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.323810 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.324587 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.326843 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.327180 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.327248 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.329582 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.329586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.329589 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.329621 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.332331 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.333047 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.333051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.333053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.333144 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.333505 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.333509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.333511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.333753 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.333871 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.334386 (+ 515us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.334542 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 16:57:33.336241 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.320944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58118 (local address 127.7.153.60:42445)
0806 16:57:33.321229 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.321233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.321703 (+ 470us) server_negotiation.cc:407] Connection header received
0806 16:57:33.321798 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.321801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.321850 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.321935 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.323682 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.324516 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.326749 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.327093 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.327167 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.330720 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.330724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.330727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.330761 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.333839 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.334394 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.334398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.334400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.334490 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.334809 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.334814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.334817 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.335077 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.335185 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.335861 (+ 676us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.336021 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":101,"threads_started":1}
I20260806 16:57:33.342087 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.319832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:36957 (local address 127.7.153.61:41475)
0806 16:57:33.319989 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.319993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.321460 (+ 1467us) server_negotiation.cc:407] Connection header received
0806 16:57:33.322601 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.322606 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.322658 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.322717 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.324722 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.325561 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.328883 (+ 3322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.329267 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.329372 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.336904 (+ 7532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.336910 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.336916 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.336949 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.338922 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.339973 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.339978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.339980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.340094 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340531 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.340535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.340537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.340825 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.340916 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.341761 (+ 845us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.341908 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 16:57:33.342087 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.318756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:55035 (local address 127.7.153.60:42445)
0806 16:57:33.318897 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.318903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.321192 (+ 2289us) server_negotiation.cc:407] Connection header received
0806 16:57:33.322565 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.322568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.322618 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.322672 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.325275 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.326025 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.329118 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.329486 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.329563 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.336461 (+ 6898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.336465 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.336467 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.336493 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.339046 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340145 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.340151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.340155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.340246 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340547 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.340551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.340552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.340833 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.340916 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.341761 (+ 845us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.341908 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:57:33.342762 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.320596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:39499 (local address 127.7.153.62:33283)
0806 16:57:33.320875 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.320888 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.322038 (+ 1150us) server_negotiation.cc:407] Connection header received
0806 16:57:33.322566 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.322568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.322616 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.322677 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.325092 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.325993 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.329553 (+ 3560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.329989 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.330075 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.336434 (+ 6359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.336441 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.336447 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.336472 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.339056 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.339992 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.339995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.339997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.340086 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340527 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.340530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.340531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.340828 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.340917 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.342151 (+ 1234us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.342576 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":98,"threads_started":1}
I20260806 16:57:33.343990 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.320412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:39499)
0806 16:57:33.321920 (+ 1508us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.321934 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.322445 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.323112 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.323123 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.324805 (+ 1682us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:33.324931 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.324953 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.326176 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.326180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.328746 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.328764 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.330280 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.330287 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.330388 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.330945 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:33.330962 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:33.336084 (+ 5122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:33.339565 (+ 3481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.339568 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.339570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.339864 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.340192 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340195 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.340197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.340405 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.340991 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:33.340999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:33.341419 (+ 420us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.342906 (+ 1487us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.343068 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1435,"mutex_wait_us":542,"thread_start_us":84,"threads_started":1}
I20260806 16:57:33.339883 14268 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52960:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 16:57:33.345108 15621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.319295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.7.153.3:55035)
0806 16:57:33.321018 (+ 1723us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.321091 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.322310 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.323112 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.323123 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.325032 (+ 1909us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:33.325150 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.325156 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.326176 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.326180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.328976 (+ 2796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.328986 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.329786 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.329792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.330658 (+ 866us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.331428 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:33.331445 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:33.336264 (+ 4819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:33.339180 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.339185 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.339187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.340025 (+ 838us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.340360 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340363 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.340365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.340442 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.340991 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:33.340999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:33.341433 (+ 434us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.342348 (+ 915us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.342917 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1477,"mutex_wait_us":1698,"spinlock_wait_cycles":4736,"thread_start_us":128,"threads_started":1}
I20260806 16:57:33.345458 15613 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33283
I20260806 16:57:33.345678 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.319295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.7.153.3:36957)
0806 16:57:33.321370 (+ 2075us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.321385 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.322462 (+ 1077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.323113 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.323133 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.323821 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:33.324549 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.324573 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.326229 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.326231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.328748 (+ 2517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.328764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.329989 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.329993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.330247 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.330905 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:33.330930 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:33.335768 (+ 4838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:33.339100 (+ 3332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.339112 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.339142 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.339849 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.340205 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:33.340210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:33.340213 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:33.340414 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:33.340991 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:33.340999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:33.341429 (+ 430us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.342342 (+ 913us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.344066 (+ 1724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1955,"mutex_wait_us":1964,"spinlock_wait_cycles":26624,"thread_start_us":168,"threads_started":1}
I20260806 16:57:33.345722 15613 heartbeater.cc:464] Registering TS with master...
W20260806 16:57:33.345718 14268 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:33.346019 15614 heartbeater.cc:347] Connected to a master server at 127.7.153.60:42445
I20260806 16:57:33.346100 15614 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:33.346303 15615 heartbeater.cc:347] Connected to a master server at 127.7.153.61:41475
I20260806 16:57:33.346374 15615 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:33.346452 15614 heartbeater.cc:511] Master 127.7.153.60:42445 requested a full tablet report, sending...
I20260806 16:57:33.346509 15615 heartbeater.cc:511] Master 127.7.153.61:41475 requested a full tablet report, sending...
I20260806 16:57:33.346455 15613 heartbeater.cc:511] Master 127.7.153.62:33283 requested a full tablet report, sending...
I20260806 16:57:33.347743 15116 ts_manager.cc:194] Registered new tserver with Master: 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341)
I20260806 16:57:33.347920 14267 ts_manager.cc:194] Re-registered known tserver with Master: 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341)
I20260806 16:57:33.348347 14917 ts_manager.cc:194] Registered new tserver with Master: 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341)
I20260806 16:57:33.348766 14267 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:39499
I20260806 16:57:33.348886 14873 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: NON_VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: true } } }
I20260806 16:57:33.349007 14873 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:33.353427 15631 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: attempting to promote NON_VOTER dc5a89cafb174c53b18565ce89e129ad to VOTER
I20260806 16:57:33.353896 15631 consensus_queue.cc:237] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:33.355274 14920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Refusing update from remote peer e840087cb4a34383841d440dc1125d60: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 16:57:33.355633 15128 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 LEARNER]: Refusing update from remote peer e840087cb4a34383841d440dc1125d60: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 16:57:33.355713 15633 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 16:57:33.356031 15633 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 16:57:33.357771 14873 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, dc5a89cafb174c53b18565ce89e129ad (127.7.153.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.358454 15128 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, dc5a89cafb174c53b18565ce89e129ad (127.7.153.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.359648 15631 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.359788 15631 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:33.360850 15159 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.360991 15159 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:33.361728 14920 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, dc5a89cafb174c53b18565ce89e129ad (127.7.153.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.363821 15641 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.363998 15641 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:33.363986 14873 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.364022 15631 sys_catalog.cc:455] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e840087cb4a34383841d440dc1125d60" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:33.364128 14873 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:33.364142 15631 sys_catalog.cc:458] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:33.373648 15643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.367162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:41341 (local address 127.0.0.1:53456)
0806 16:57:33.367859 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.367875 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.367993 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.369375 (+ 1382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.369378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.369399 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.369552 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.369563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.370610 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.370614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.371895 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.371906 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.373220 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.373224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.373325 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.373350 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.373429 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.373505 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617}
I20260806 16:57:33.373865 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.367346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.7.153.3:41341)
0806 16:57:33.367730 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.367744 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.368146 (+ 402us) server_negotiation.cc:407] Connection header received
0806 16:57:33.368267 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.368279 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.368560 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.368783 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.369697 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.370472 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.372041 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.372871 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.372994 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.373155 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.373505 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.373638 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":175,"threads_started":1}
I20260806 16:57:33.376950 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.368888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34463 (local address 127.0.0.1:42550)
0806 16:57:33.369116 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.369128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.369203 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.372238 (+ 3035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.372242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.372263 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.372365 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.372372 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.374097 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.374100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.375041 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.375050 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.376303 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.376306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.376467 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.376494 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.376673 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.376790 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
I20260806 16:57:33.376995 15646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.369061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42550 (local address 127.7.153.2:34463)
0806 16:57:33.371547 (+ 2486us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.371565 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.371596 (+ 31us) server_negotiation.cc:407] Connection header received
0806 16:57:33.371680 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.371685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.371900 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.372066 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.372511 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.373605 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.375172 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.376172 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.376299 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.376499 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.376748 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.376848 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2063,"thread_start_us":117,"threads_started":1}
I20260806 16:57:33.378118 15536 tablet_service.cc:1467] Processing CreateTablet for tablet 355b4bacbb9c4788bb139e0791ecea32 (DEFAULT_TABLE table=test-table [id=281376b46e584557904830f6bb2a9ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:33.379511 15536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355b4bacbb9c4788bb139e0791ecea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:33.380548 15388 tablet_service.cc:1467] Processing CreateTablet for tablet 355b4bacbb9c4788bb139e0791ecea32 (DEFAULT_TABLE table=test-table [id=281376b46e584557904830f6bb2a9ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:33.381831 15388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355b4bacbb9c4788bb139e0791ecea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:33.386401 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.367497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46753 (local address 127.0.0.1:48772)
0806 16:57:33.367993 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.368007 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.368074 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.369601 (+ 1527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.369608 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.369631 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.369720 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.369726 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.371032 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.371036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.372042 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.372052 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.385832 (+ 13780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.385837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.385978 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.386007 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.386119 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.386234 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":196,"threads_started":1}
I20260806 16:57:33.386462 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.367819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48772 (local address 127.7.153.1:46753)
0806 16:57:33.369055 (+ 1236us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.369073 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.369098 (+ 25us) server_negotiation.cc:407] Connection header received
0806 16:57:33.369189 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.369198 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.369412 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.369863 (+ 451us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.369981 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.370901 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.372199 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.385670 (+ 13471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.385836 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.386006 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.386189 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.386310 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1115,"thread_start_us":124,"threads_started":1}
I20260806 16:57:33.390341 15240 tablet_service.cc:1467] Processing CreateTablet for tablet 355b4bacbb9c4788bb139e0791ecea32 (DEFAULT_TABLE table=test-table [id=281376b46e584557904830f6bb2a9ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:33.391702 15240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355b4bacbb9c4788bb139e0791ecea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:33.393105 15648 tablet_bootstrap.cc:492] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Bootstrap starting.
I20260806 16:57:33.395233 15647 tablet_bootstrap.cc:492] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Bootstrap starting.
I20260806 16:57:33.398087 15647 tablet_bootstrap.cc:654] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:33.399160 15647 log.cc:824] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:33.400538 15648 tablet_bootstrap.cc:654] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:33.400892 15650 tablet_bootstrap.cc:492] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Bootstrap starting.
I20260806 16:57:33.401561 15648 log.cc:824] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:33.401837 15647 tablet_bootstrap.cc:492] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: No bootstrap required, opened a new log
I20260806 16:57:33.402088 15647 ts_tablet_manager.cc:1397] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 16:57:33.403774 15650 tablet_bootstrap.cc:654] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:33.404206 15648 tablet_bootstrap.cc:492] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: No bootstrap required, opened a new log
I20260806 16:57:33.404525 15648 ts_tablet_manager.cc:1397] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260806 16:57:33.404743 15650 log.cc:824] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:33.407275 15650 tablet_bootstrap.cc:492] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: No bootstrap required, opened a new log
I20260806 16:57:33.407543 15650 ts_tablet_manager.cc:1397] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 16:57:33.407961 15647 raft_consensus.cc:348] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.408293 15647 raft_consensus.cc:374] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:33.408357 15647 raft_consensus.cc:729] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 083e7294b8f24867a8f614cfae4fd209, State: Initialized, Role: FOLLOWER
I20260806 16:57:33.409031 15647 consensus_queue.cc:260] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.409976 15613 heartbeater.cc:503] Master 127.7.153.62:33283 was elected leader, sending a full tablet report...
I20260806 16:57:33.410017 15648 raft_consensus.cc:348] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.410315 15648 raft_consensus.cc:374] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:33.410329 15647 ts_tablet_manager.cc:1428] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 16:57:33.410403 15648 raft_consensus.cc:729] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658879b124224d9994ce699b7a3a8189, State: Initialized, Role: FOLLOWER
I20260806 16:57:33.410852 15648 consensus_queue.cc:260] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.411624 15460 heartbeater.cc:503] Master 127.7.153.62:33283 was elected leader, sending a full tablet report...
I20260806 16:57:33.412022 15648 ts_tablet_manager.cc:1428] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 16:57:33.417145 15650 raft_consensus.cc:348] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.417582 15650 raft_consensus.cc:374] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:33.417657 15650 raft_consensus.cc:729] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9bc767af21e4a588f5e63ff0ee55503, State: Initialized, Role: FOLLOWER
I20260806 16:57:33.418326 15650 consensus_queue.cc:260] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.419268 15310 heartbeater.cc:503] Master 127.7.153.62:33283 was elected leader, sending a full tablet report...
I20260806 16:57:33.419685 15650 ts_tablet_manager.cc:1428] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260806 16:57:33.517023 15654 raft_consensus.cc:482] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:33.517357 15654 raft_consensus.cc:504] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.518669 15654 leader_election.cc:288] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753), 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463)
I20260806 16:57:33.520634 15655 raft_consensus.cc:482] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:33.520875 15655 raft_consensus.cc:504] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.522202 15655 leader_election.cc:288] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341), b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753)
I20260806 16:57:33.523425 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.519101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:48839 (local address 127.7.153.1:46753)
0806 16:57:33.519251 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.519256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.519773 (+ 517us) server_negotiation.cc:407] Connection header received
0806 16:57:33.519859 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.519865 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.519918 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.519999 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.520251 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.521023 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.522047 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.522674 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.522791 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.522862 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.523228 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.523303 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:57:33.523476 15621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.518973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46753 (local address 127.7.153.3:48839)
0806 16:57:33.519669 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.519684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.519772 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.520018 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.520020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.520033 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.520129 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.520133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.521130 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.521133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.521913 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.521922 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.522929 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.522933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.523047 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.523076 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.523165 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.523299 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":619}
I20260806 16:57:33.524098 15646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.519126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:52125 (local address 127.7.153.2:34463)
0806 16:57:33.519250 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.519255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.519274 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:33.519337 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.519339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.519398 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.519465 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.519804 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.520581 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.522101 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.522719 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.522807 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.522862 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.523888 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.523975 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 16:57:33.524392 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.518973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34463 (local address 127.7.153.3:52125)
0806 16:57:33.519109 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.519128 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.519253 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.519495 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.519497 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.519513 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.519667 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.519675 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.520750 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.520755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.521963 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.521975 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.522979 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.522982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.523076 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.523093 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.523158 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.523270 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":7}
I20260806 16:57:33.524806 15262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b4bacbb9c4788bb139e0791ecea32" candidate_uuid: "083e7294b8f24867a8f614cfae4fd209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9bc767af21e4a588f5e63ff0ee55503" is_pre_election: true
I20260806 16:57:33.525143 15262 raft_consensus.cc:2454] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 083e7294b8f24867a8f614cfae4fd209 in term 0.
I20260806 16:57:33.525713 15488 leader_election.cc:302] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 083e7294b8f24867a8f614cfae4fd209, b9bc767af21e4a588f5e63ff0ee55503; no voters:
I20260806 16:57:33.526024 15410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b4bacbb9c4788bb139e0791ecea32" candidate_uuid: "083e7294b8f24867a8f614cfae4fd209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658879b124224d9994ce699b7a3a8189" is_pre_election: true
I20260806 16:57:33.526237 15410 raft_consensus.cc:2454] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 083e7294b8f24867a8f614cfae4fd209 in term 0.
I20260806 16:57:33.526233 15654 raft_consensus.cc:2781] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:33.526320 15654 raft_consensus.cc:482] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:33.526364 15654 raft_consensus.cc:3037] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:33.527024 15465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.522395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:41341 (local address 127.7.153.2:49831)
0806 16:57:33.522826 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.522842 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.522930 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.523378 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.523381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.523397 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.523505 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.523514 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.524465 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.524472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.525620 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.525632 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.526563 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.526566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.526664 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.526688 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.526757 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.526829 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254}
I20260806 16:57:33.527484 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.522850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46753 (local address 127.7.153.2:45419)
0806 16:57:33.523021 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:33.523034 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:33.523103 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:33.523822 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:33.523825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:33.523844 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:33.523937 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.523943 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.525176 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.525180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.526237 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:33.526246 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.527060 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.527064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:33.527179 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.527206 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:57:33.527290 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 16:57:33.527360 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 16:57:33.527503 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.522481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:49831 (local address 127.7.153.3:41341)
0806 16:57:33.522615 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.522620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.523014 (+ 394us) server_negotiation.cc:407] Connection header received
0806 16:57:33.523064 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.523066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.523128 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.523197 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.523646 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.524347 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.525763 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.526359 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.526447 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.526507 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.527319 (+ 812us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.527396 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 16:57:33.527513 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.523396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:45419 (local address 127.7.153.1:46753)
0806 16:57:33.523600 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.523604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.523620 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:33.523663 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.523665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.523718 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.523790 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:33.524336 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.525028 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.526375 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.526942 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.527051 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.527113 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.527331 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.527395 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":142,"threads_started":1}
I20260806 16:57:33.527901 15654 raft_consensus.cc:504] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.528100 15558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b4bacbb9c4788bb139e0791ecea32" candidate_uuid: "658879b124224d9994ce699b7a3a8189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "083e7294b8f24867a8f614cfae4fd209" is_pre_election: true
I20260806 16:57:33.528314 15558 raft_consensus.cc:2379] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 658879b124224d9994ce699b7a3a8189 in current term 1: Already voted for candidate 083e7294b8f24867a8f614cfae4fd209 in this term.
I20260806 16:57:33.528344 15654 leader_election.cc:288] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [CANDIDATE]: Term 1 election: Requested vote from peers b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753), 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463)
I20260806 16:57:33.528676 15262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b4bacbb9c4788bb139e0791ecea32" candidate_uuid: "083e7294b8f24867a8f614cfae4fd209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9bc767af21e4a588f5e63ff0ee55503"
I20260806 16:57:33.528820 15410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b4bacbb9c4788bb139e0791ecea32" candidate_uuid: "083e7294b8f24867a8f614cfae4fd209" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658879b124224d9994ce699b7a3a8189"
I20260806 16:57:33.528928 15410 raft_consensus.cc:3037] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:33.528918 15262 raft_consensus.cc:3037] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:33.530536 15410 raft_consensus.cc:2454] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 083e7294b8f24867a8f614cfae4fd209 in term 1.
I20260806 16:57:33.530658 15262 raft_consensus.cc:2454] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 083e7294b8f24867a8f614cfae4fd209 in term 1.
I20260806 16:57:33.530964 15491 leader_election.cc:302] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 083e7294b8f24867a8f614cfae4fd209, 658879b124224d9994ce699b7a3a8189; no voters:
I20260806 16:57:33.531179 15654 raft_consensus.cc:2781] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:33.531502 15654 raft_consensus.cc:686] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 1 LEADER]: Becoming Leader. State: Replica: 083e7294b8f24867a8f614cfae4fd209, State: Running, Role: LEADER
I20260806 16:57:33.531522 15262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b4bacbb9c4788bb139e0791ecea32" candidate_uuid: "658879b124224d9994ce699b7a3a8189" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9bc767af21e4a588f5e63ff0ee55503" is_pre_election: true
I20260806 16:57:33.531699 15262 raft_consensus.cc:2379] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 658879b124224d9994ce699b7a3a8189 in current term 1: Already voted for candidate 083e7294b8f24867a8f614cfae4fd209 in this term.
I20260806 16:57:33.531944 15654 consensus_queue.cc:237] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } }
I20260806 16:57:33.532470 15337 leader_election.cc:302] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 658879b124224d9994ce699b7a3a8189; no voters: 083e7294b8f24867a8f614cfae4fd209, b9bc767af21e4a588f5e63ff0ee55503
I20260806 16:57:33.533068 15655 raft_consensus.cc:2726] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 16:57:33.537264 14268 catalog_manager.cc:5495] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 reported cstate change: term changed from 0 to 1, leader changed from <none> to 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "083e7294b8f24867a8f614cfae4fd209" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } health_report { overall_health: UNKNOWN } } }
W20260806 16:57:33.569854 15616 tablet.cc:2369] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:33.575006 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.571376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53460 (local address 127.7.153.3:41341)
0806 16:57:33.571512 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.571515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.571555 (+ 40us) server_negotiation.cc:407] Connection header received
0806 16:57:33.571631 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.571633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.571688 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.571775 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:33.572025 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.572552 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.573434 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.573680 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.573778 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.574132 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:33.574655 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:33.574752 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.574836 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.574890 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 16:57:33.576076 15463 tablet.cc:2369] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:33.581861 15262 raft_consensus.cc:1261] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Refusing update from remote peer 083e7294b8f24867a8f614cfae4fd209: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:33.581903 15410 raft_consensus.cc:1261] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Refusing update from remote peer 083e7294b8f24867a8f614cfae4fd209: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:33.582649 15654 consensus_queue.cc:1035] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:33.582851 15660 consensus_queue.cc:1035] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:33.604455 14268 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:33.604665 14268 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:33.609768 14268 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e840087cb4a34383841d440dc1125d60: Sending DeleteTablet for 3 replicas of tablet 355b4bacbb9c4788bb139e0791ecea32
I20260806 16:57:33.610780 15388 tablet_service.cc:1514] Processing DeleteTablet for tablet 355b4bacbb9c4788bb139e0791ecea32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:33 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:42550
I20260806 16:57:33.611325 15536 tablet_service.cc:1514] Processing DeleteTablet for tablet 355b4bacbb9c4788bb139e0791ecea32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:33 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:53456
I20260806 16:57:33.611822 15674 tablet_replica.cc:330] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: stopping tablet replica
I20260806 16:57:33.612205 15674 raft_consensus.cc:2229] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:33.612325 15240 tablet_service.cc:1514] Processing DeleteTablet for tablet 355b4bacbb9c4788bb139e0791ecea32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:33 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:48772
I20260806 16:57:33.612607 15674 raft_consensus.cc:2258] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:33.614216 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14232
I20260806 16:57:33.617352 15674 ts_tablet_manager.cc:1905] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:33.620819 15674 ts_tablet_manager.cc:1918] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:33.620949 15674 log.cc:1196] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/355b4bacbb9c4788bb139e0791ecea32
I20260806 16:57:33.621389 15674 ts_tablet_manager.cc:1939] T 355b4bacbb9c4788bb139e0791ecea32 P 083e7294b8f24867a8f614cfae4fd209: Deleting consensus metadata
I20260806 16:57:33.625564 15676 tablet_replica.cc:330] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: stopping tablet replica
I20260806 16:57:33.626017 15676 raft_consensus.cc:2229] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:33.626482 15676 raft_consensus.cc:2258] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:33.626959 15673 tablet_replica.cc:330] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: stopping tablet replica
I20260806 16:57:33.627323 15673 raft_consensus.cc:2229] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:33.627640 15673 raft_consensus.cc:2258] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:33.628850 15676 ts_tablet_manager.cc:1905] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:33.630663 15673 ts_tablet_manager.cc:1905] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:33.632838 15676 ts_tablet_manager.cc:1918] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:33.633113 15676 log.cc:1196] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/355b4bacbb9c4788bb139e0791ecea32
I20260806 16:57:33.633584 15676 ts_tablet_manager.cc:1939] T 355b4bacbb9c4788bb139e0791ecea32 P b9bc767af21e4a588f5e63ff0ee55503: Deleting consensus metadata
I20260806 16:57:33.633607 15673 ts_tablet_manager.cc:1918] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:33.633716 15673 log.cc:1196] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/355b4bacbb9c4788bb139e0791ecea32
I20260806 16:57:33.634040 15673 ts_tablet_manager.cc:1939] T 355b4bacbb9c4788bb139e0791ecea32 P 658879b124224d9994ce699b7a3a8189: Deleting consensus metadata
W20260806 16:57:33.634208 15488 connection.cc:535] server connection from 127.0.0.1:53456 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 16:57:33.635463 15190 connection.cc:441] server connection from 127.0.0.1:48772 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48772 (request call id 1) could send its response
W20260806 16:57:33.637022 15339 connection.cc:441] server connection from 127.0.0.1:42550 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42550 (request call id 1) could send its response
I20260806 16:57:33.640146 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.612912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57630 (local address 127.7.153.61:41475)
0806 16:57:33.613021 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.613026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.614224 (+ 1198us) server_negotiation.cc:407] Connection header received
0806 16:57:33.614436 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.614442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.614502 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.614558 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.616751 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.617861 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.619552 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.620101 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.620217 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.635458 (+ 15241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.635463 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.635488 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.635550 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.637651 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.638212 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.638216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.638218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.638311 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.638625 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.638628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.638630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.638869 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.639000 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.639854 (+ 854us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.639979 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 16:57:33.650269 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.638433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58132 (local address 127.7.153.60:42445)
0806 16:57:33.638580 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.638585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.639350 (+ 765us) server_negotiation.cc:407] Connection header received
0806 16:57:33.639514 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.639517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.639564 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.639617 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.641711 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.642485 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.643823 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.644226 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.644317 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.646413 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.646418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.646423 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.646455 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.648129 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.648732 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.648735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.648737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.648827 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.649178 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.649182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.649184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.649430 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.649555 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.649938 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.650087 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50,"spinlock_wait_cycles":2944}
I20260806 16:57:33.650303 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.638690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57642 (local address 127.7.153.61:41475)
0806 16:57:33.638820 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.638824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.639307 (+ 483us) server_negotiation.cc:407] Connection header received
0806 16:57:33.639497 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.639500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.639551 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.639604 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.641598 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.642412 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.643871 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.644236 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.644312 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.646278 (+ 1966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.646283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.646286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.646314 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.648013 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.648639 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.648643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.648646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.648784 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.649174 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.649178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.649180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.649441 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.649544 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.649940 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.650096 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 16:57:33.651479 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:33.612849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58124 (local address 127.7.153.60:42445)
0806 16:57:33.612974 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:33.612979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:33.639688 (+ 26709us) server_negotiation.cc:407] Connection header received
0806 16:57:33.639766 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:33.639768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:33.639815 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:33.639888 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:33.640774 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.641586 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.642727 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:33.643049 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:33.643156 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:33.645745 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:33.645750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:33.645756 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:33.645791 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:33.649165 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.649892 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.649897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.649898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.649979 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:33.650284 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:33.650288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:33.650289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:33.650504 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:33.650726 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:33.651175 (+ 449us) server_negotiation.cc:299] Negotiation successful
0806 16:57:33.651323 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 16:57:34.598466 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:34.597952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:40339)
0806 16:57:34.598232 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:34.598336 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":95,"threads_started":1}
W20260806 16:57:34.599011 15460 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:33283 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:34.603466 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:34.602920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:34669)
0806 16:57:34.603210 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:34.603330 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":73,"threads_started":1}
W20260806 16:57:34.603833 15310 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:33283 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:34.603960 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:34.603536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:53691)
0806 16:57:34.603769 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:34.603853 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
W20260806 16:57:34.604223 15613 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:33283 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:35.110211 15687 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e840087cb4a34383841d440dc1125d60)
I20260806 16:57:35.110456 15687 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:35.111624 15687 leader_election.cc:288] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283), b1a85c7ac4874212806f83efbd0dd8e6 (127.7.153.61:41475)
I20260806 16:57:35.111620 15688 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e840087cb4a34383841d440dc1125d60)
I20260806 16:57:35.111842 15688 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:35.112433 15689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.111868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53422)
0806 16:57:35.112217 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.112317 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":88,"threads_started":1}
W20260806 16:57:35.112634 15101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:35.113081 15688 leader_election.cc:288] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283), dc5a89cafb174c53b18565ce89e129ad (127.7.153.60:42445)
I20260806 16:57:35.113989 15689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.113739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53452)
0806 16:57:35.113852 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.113910 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 16:57:35.113745 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.113204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53436)
0806 16:57:35.113475 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.113549 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":63,"threads_started":1}
W20260806 16:57:35.114172 15101 leader_election.cc:334] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
W20260806 16:57:35.114323 14901 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:35.115334 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.115107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53462)
0806 16:57:35.115211 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.115264 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 16:57:35.115483 14901 leader_election.cc:334] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:35.117483 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.113228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:42445 (local address 127.0.0.1:58134)
0806 16:57:35.113765 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.113781 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:35.113877 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:35.114317 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:35.114322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:35.114344 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:35.114463 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:35.114470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.115372 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.115378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:35.116321 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:35.116331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.117043 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.117047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:35.117145 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:35.117182 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 16:57:35.117261 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 16:57:35.117338 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":47,"threads_started":1}
I20260806 16:57:35.117506 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.112238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:41475 (local address 127.0.0.1:57654)
0806 16:57:35.112497 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.112512 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:35.113143 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:35.113561 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:35.113564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:35.113584 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:35.113706 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:35.113713 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.115119 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.115126 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:35.116233 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:35.116244 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.116993 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.116997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:35.117133 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:35.117168 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 16:57:35.117266 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 16:57:35.117364 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":4,"thread_start_us":75,"threads_started":1}
I20260806 16:57:35.117799 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.112367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.7.153.61:41475)
0806 16:57:35.112766 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:35.112773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:35.113208 (+ 435us) server_negotiation.cc:407] Connection header received
0806 16:57:35.113264 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:35.113268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:35.113325 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:35.113404 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:35.113843 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.114954 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.116369 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.116866 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.116987 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:35.117050 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:35.117576 (+ 526us) server_negotiation.cc:299] Negotiation successful
0806 16:57:35.117673 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":109,"threads_started":1}
I20260806 16:57:35.117491 15696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.113434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58134 (local address 127.7.153.60:42445)
0806 16:57:35.113990 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:35.114000 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:35.114014 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:57:35.114060 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:35.114062 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:35.114128 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:35.114215 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:35.114564 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.115264 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.116460 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:35.116923 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:35.117043 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:35.117190 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:35.117272 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 16:57:35.117350 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":427,"thread_start_us":108,"threads_started":1}
I20260806 16:57:35.118376 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc5a89cafb174c53b18565ce89e129ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" is_pre_election: true
I20260806 16:57:35.118474 15128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc5a89cafb174c53b18565ce89e129ad" is_pre_election: true
I20260806 16:57:35.118680 14920 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc5a89cafb174c53b18565ce89e129ad in term 1.
I20260806 16:57:35.118713 15128 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a85c7ac4874212806f83efbd0dd8e6 in term 1.
I20260806 16:57:35.119167 14903 leader_election.cc:302] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1a85c7ac4874212806f83efbd0dd8e6, dc5a89cafb174c53b18565ce89e129ad; no voters: e840087cb4a34383841d440dc1125d60
I20260806 16:57:35.119148 15101 leader_election.cc:302] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1a85c7ac4874212806f83efbd0dd8e6, dc5a89cafb174c53b18565ce89e129ad; no voters: e840087cb4a34383841d440dc1125d60
I20260806 16:57:35.119400 15687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 16:57:35.119470 15687 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader e840087cb4a34383841d440dc1125d60)
I20260806 16:57:35.119526 15687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 1 FOLLOWER]: Advancing to term 2
I20260806 16:57:35.120679 15687 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:35.120836 15688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 16:57:35.120904 15688 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e840087cb4a34383841d440dc1125d60)
I20260806 16:57:35.120951 15688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 1 FOLLOWER]: Advancing to term 2
I20260806 16:57:35.121241 15687 leader_election.cc:288] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [CANDIDATE]: Term 2 election: Requested vote from peers e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283), b1a85c7ac4874212806f83efbd0dd8e6 (127.7.153.61:41475)
I20260806 16:57:35.121801 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.121513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53464)
0806 16:57:35.121642 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.121709 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 16:57:35.121963 14920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc5a89cafb174c53b18565ce89e129ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b1a85c7ac4874212806f83efbd0dd8e6"
I20260806 16:57:35.122277 15688 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:35.122560 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.122326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53480)
0806 16:57:35.122433 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.122487 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 16:57:35.122704 15101 leader_election.cc:334] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:35.122773 14920 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dc5a89cafb174c53b18565ce89e129ad in current term 2: Already voted for candidate b1a85c7ac4874212806f83efbd0dd8e6 in this term.
I20260806 16:57:35.122951 15688 leader_election.cc:288] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 2 election: Requested vote from peers e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283), dc5a89cafb174c53b18565ce89e129ad (127.7.153.60:42445)
I20260806 16:57:35.123162 15101 leader_election.cc:302] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc5a89cafb174c53b18565ce89e129ad; no voters: b1a85c7ac4874212806f83efbd0dd8e6, e840087cb4a34383841d440dc1125d60
I20260806 16:57:35.123288 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.122782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53484)
0806 16:57:35.123131 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.123194 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277}
I20260806 16:57:35.123353 15128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc5a89cafb174c53b18565ce89e129ad"
I20260806 16:57:35.123425 15687 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 16:57:35.123580 15128 raft_consensus.cc:2379] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b1a85c7ac4874212806f83efbd0dd8e6 in current term 2: Already voted for candidate dc5a89cafb174c53b18565ce89e129ad in this term.
I20260806 16:57:35.124006 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.123699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53492)
0806 16:57:35.123817 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.123948 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 16:57:35.124152 14901 leader_election.cc:334] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:35.124236 14901 leader_election.cc:302] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1a85c7ac4874212806f83efbd0dd8e6; no voters: dc5a89cafb174c53b18565ce89e129ad, e840087cb4a34383841d440dc1125d60
I20260806 16:57:35.124370 15688 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 16:57:35.600201 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.599565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:57997)
0806 16:57:35.600023 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.600090 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":109,"threads_started":1}
I20260806 16:57:35.604880 15699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.604389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:51009)
0806 16:57:35.604669 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.604781 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":114,"threads_started":1}
I20260806 16:57:35.605243 15700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:35.604801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:46389)
0806 16:57:35.605054 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:35.605118 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":102,"threads_started":1}
I20260806 16:57:36.601475 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.601000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:58549)
0806 16:57:36.601264 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.601337 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":93,"threads_started":1}
I20260806 16:57:36.606222 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.605735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:50959)
0806 16:57:36.606028 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.606104 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":79,"threads_started":1}
I20260806 16:57:36.606356 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.605963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:49939)
0806 16:57:36.606200 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.606252 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":87,"threads_started":1}
I20260806 16:57:36.980784 15705 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:36.980949 15705 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:36.981532 15705 leader_election.cc:288] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283), dc5a89cafb174c53b18565ce89e129ad (127.7.153.60:42445)
I20260806 16:57:36.982057 15128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc5a89cafb174c53b18565ce89e129ad" is_pre_election: true
I20260806 16:57:36.982236 15128 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a85c7ac4874212806f83efbd0dd8e6 in term 2.
I20260806 16:57:36.982262 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.981798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53728)
0806 16:57:36.982062 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.982122 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":106,"threads_started":1}
I20260806 16:57:36.982606 14903 leader_election.cc:302] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a85c7ac4874212806f83efbd0dd8e6, dc5a89cafb174c53b18565ce89e129ad; no voters:
I20260806 16:57:36.982836 15705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 16:57:36.982918 15705 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:36.983009 15705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 2 FOLLOWER]: Advancing to term 3
I20260806 16:57:36.983152 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.982896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53730)
0806 16:57:36.983011 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.983069 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 16:57:36.983276 14901 leader_election.cc:334] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:36.984315 15705 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:36.984664 15705 leader_election.cc:288] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 3 election: Requested vote from peers e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283), dc5a89cafb174c53b18565ce89e129ad (127.7.153.60:42445)
I20260806 16:57:36.985064 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.984847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53734)
0806 16:57:36.984936 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.984992 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260806 16:57:36.985112 15128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dc5a89cafb174c53b18565ce89e129ad"
I20260806 16:57:36.985253 15128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 2 FOLLOWER]: Advancing to term 3
I20260806 16:57:36.985877 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:36.985650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53736)
0806 16:57:36.985767 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:36.985819 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 16:57:36.986003 14901 leader_election.cc:334] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
I20260806 16:57:36.986585 15128 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a85c7ac4874212806f83efbd0dd8e6 in term 3.
I20260806 16:57:36.986997 14903 leader_election.cc:302] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1a85c7ac4874212806f83efbd0dd8e6, dc5a89cafb174c53b18565ce89e129ad; no voters: e840087cb4a34383841d440dc1125d60
I20260806 16:57:36.987170 15705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 16:57:36.987373 15705 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [term 3 LEADER]: Becoming Leader. State: Replica: b1a85c7ac4874212806f83efbd0dd8e6, State: Running, Role: LEADER
I20260806 16:57:36.987670 15705 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } }
I20260806 16:57:36.989288 15708 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1a85c7ac4874212806f83efbd0dd8e6. Latest consensus state: current_term: 3 leader_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:36.989434 15708 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:36.989751 15710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:36.992925 15710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:36.993562 15710 catalog_manager.cc:1259] Loaded cluster ID: 8290c0a657214072b7e48e8b83f452f5
I20260806 16:57:36.993642 15710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:36.994527 15710 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:36.995117 15710 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Loaded TSK: 0
I20260806 16:57:36.996261 15710 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:57:37.053902 14917 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:37.057264 14917 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:37.060596 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.060304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53756)
0806 16:57:37.060434 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.060501 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 16:57:37.060848 15128 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [term 3 FOLLOWER]: Refusing update from remote peer b1a85c7ac4874212806f83efbd0dd8e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260806 16:57:37.061480 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.061223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.0.0.1:53766)
0806 16:57:37.061338 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.061397 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 16:57:37.061520 15708 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260806 16:57:37.061695 14901 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 -> Peer e840087cb4a34383841d440dc1125d60 (127.7.153.62:33283): Couldn't send request to peer e840087cb4a34383841d440dc1125d60. Status: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 16:57:37.063194 15712 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1a85c7ac4874212806f83efbd0dd8e6. Latest consensus state: current_term: 3 leader_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:37.063350 15712 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:37.064659 15708 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:37.064822 15708 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:37.065193 15712 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e840087cb4a34383841d440dc1125d60" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33283 } } peers { permanent_uuid: "b1a85c7ac4874212806f83efbd0dd8e6" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 41475 } attrs { promote: false } } peers { permanent_uuid: "dc5a89cafb174c53b18565ce89e129ad" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 42445 } attrs { promote: false } } }
I20260806 16:57:37.065340 15712 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc5a89cafb174c53b18565ce89e129ad [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:57:37.077065 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.071504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34463 (local address 127.0.0.1:42560)
0806 16:57:37.071623 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.071638 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:37.071733 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:37.072411 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:37.072416 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:37.072435 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:37.072563 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.072569 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.074124 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.074132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.075635 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.075646 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.076535 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.076539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.076648 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.076678 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 16:57:37.076789 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 16:57:37.076888 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 16:57:37.078143 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.071863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.7.153.2:34463)
0806 16:57:37.072122 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:37.072127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:37.072152 (+ 25us) server_negotiation.cc:407] Connection header received
0806 16:57:37.072208 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:37.072211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:37.072269 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:37.072685 (+ 416us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:37.072849 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.073913 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.075863 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.076367 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.076529 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.076605 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:37.077882 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0806 16:57:37.077986 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":105,"threads_started":1}
I20260806 16:57:37.078224 15723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.072057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:41341 (local address 127.0.0.1:53468)
0806 16:57:37.073082 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.073097 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:37.073202 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:37.074003 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:37.074008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:37.074028 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:37.074138 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.074145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.075814 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.075817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.076918 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.076931 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.077776 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.077780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.077874 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.077896 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 16:57:37.077990 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 16:57:37.078075 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":967,"thread_start_us":140,"threads_started":1}
I20260806 16:57:37.078212 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.072162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.7.153.3:41341)
0806 16:57:37.072472 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:37.072476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:37.073196 (+ 720us) server_negotiation.cc:407] Connection header received
0806 16:57:37.073289 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:37.073292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:37.073708 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:37.073985 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:37.074345 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.075653 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.077064 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.077653 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.077778 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.077848 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:37.078006 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 16:57:37.078083 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20260806 16:57:37.078836 15388 tablet_service.cc:1467] Processing CreateTablet for tablet 032f0af2ed4040d29565dba5ddd74764 (DEFAULT_TABLE table=test-table [id=3ea6a2577bb0462c8e3d78a90144affa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:37.078941 15536 tablet_service.cc:1467] Processing CreateTablet for tablet 032f0af2ed4040d29565dba5ddd74764 (DEFAULT_TABLE table=test-table [id=3ea6a2577bb0462c8e3d78a90144affa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:37.079201 15388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 032f0af2ed4040d29565dba5ddd74764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:37.079311 15536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 032f0af2ed4040d29565dba5ddd74764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:37.081692 15725 tablet_bootstrap.cc:492] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Bootstrap starting.
I20260806 16:57:37.082762 15725 tablet_bootstrap.cc:654] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:37.083485 15726 tablet_bootstrap.cc:492] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Bootstrap starting.
I20260806 16:57:37.084409 15725 tablet_bootstrap.cc:492] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: No bootstrap required, opened a new log
I20260806 16:57:37.084497 15726 tablet_bootstrap.cc:654] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:37.084666 15725 ts_tablet_manager.cc:1397] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:37.085006 15719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.072812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46753 (local address 127.0.0.1:48788)
0806 16:57:37.075159 (+ 2347us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.075173 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:37.075266 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:37.077125 (+ 1859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:37.077129 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:37.077149 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:37.077245 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.077250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.078364 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.078370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.083191 (+ 4821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.083208 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.084432 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.084436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.084541 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.084610 (+ 69us) client_negotiation.cc:769] Sending connection context
0806 16:57:37.084745 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 16:57:37.084844 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2277,"thread_start_us":92,"threads_started":1}
I20260806 16:57:37.085239 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.072924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.7.153.1:46753)
0806 16:57:37.076887 (+ 3963us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:37.076893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:37.076909 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:37.076967 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:37.076971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:37.077025 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:37.077124 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:37.077348 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.078201 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.083444 (+ 5243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.084233 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.084409 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.084480 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:37.084840 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 16:57:37.084929 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3810,"thread_start_us":88,"threads_started":1}
I20260806 16:57:37.085397 15725 raft_consensus.cc:348] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.085530 15725 raft_consensus.cc:374] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:37.085574 15725 raft_consensus.cc:729] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 658879b124224d9994ce699b7a3a8189, State: Initialized, Role: FOLLOWER
I20260806 16:57:37.085718 15725 consensus_queue.cc:260] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.085841 15726 tablet_bootstrap.cc:492] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: No bootstrap required, opened a new log
I20260806 16:57:37.085831 15240 tablet_service.cc:1467] Processing CreateTablet for tablet 032f0af2ed4040d29565dba5ddd74764 (DEFAULT_TABLE table=test-table [id=3ea6a2577bb0462c8e3d78a90144affa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:37.085948 15726 ts_tablet_manager.cc:1397] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:37.086104 15725 ts_tablet_manager.cc:1428] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 16:57:37.086130 15240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 032f0af2ed4040d29565dba5ddd74764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:37.086413 15726 raft_consensus.cc:348] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.086532 15726 raft_consensus.cc:374] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:37.086566 15726 raft_consensus.cc:729] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 083e7294b8f24867a8f614cfae4fd209, State: Initialized, Role: FOLLOWER
I20260806 16:57:37.086683 15726 consensus_queue.cc:260] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.086990 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.086617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:46365)
0806 16:57:37.086833 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.086910 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260806 16:57:37.087088 15726 ts_tablet_manager.cc:1428] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:37.088440 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.087899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:38919)
0806 16:57:37.088284 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.088355 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291}
I20260806 16:57:37.088807 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.088421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:52925)
0806 16:57:37.088634 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.088736 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260806 16:57:37.091552 15462 heartbeater.cc:503] Master 127.7.153.61:41475 was elected leader, sending a full tablet report...
I20260806 16:57:37.092744 15732 tablet_bootstrap.cc:492] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503: Bootstrap starting.
I20260806 16:57:37.093732 15732 tablet_bootstrap.cc:654] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:37.095326 15732 tablet_bootstrap.cc:492] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503: No bootstrap required, opened a new log
I20260806 16:57:37.095454 15732 ts_tablet_manager.cc:1397] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:37.095924 15732 raft_consensus.cc:348] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.096033 15732 raft_consensus.cc:374] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:37.096056 15732 raft_consensus.cc:729] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9bc767af21e4a588f5e63ff0ee55503, State: Initialized, Role: FOLLOWER
I20260806 16:57:37.096230 15732 consensus_queue.cc:260] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.096658 15732 ts_tablet_manager.cc:1428] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 16:57:37.097551 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.097263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:45223)
0806 16:57:37.097385 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.097452 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 16:57:37.097667 15313 tablet.cc:2369] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:37.098661 15312 heartbeater.cc:503] Master 127.7.153.61:41475 was elected leader, sending a full tablet report...
I20260806 16:57:37.106436 15734 raft_consensus.cc:482] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:37.106616 15734 raft_consensus.cc:504] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.108517 15734 leader_election.cc:288] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463), 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341)
I20260806 16:57:37.113379 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.108300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:55953 (local address 127.7.153.3:41341)
0806 16:57:37.108445 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:37.108450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:37.108468 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:57:37.108552 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:37.108557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:37.108619 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:37.108748 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:37.109054 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.109870 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.111780 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.112414 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.112535 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.112611 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:37.113141 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 16:57:37.113228 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 16:57:37.113399 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.108284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:40787 (local address 127.7.153.2:34463)
0806 16:57:37.108414 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:37.108418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:37.108797 (+ 379us) server_negotiation.cc:407] Connection header received
0806 16:57:37.108951 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:37.108953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:37.109024 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:37.109109 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:37.109378 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.110072 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.111780 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.112414 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.112535 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.112611 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:37.113141 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 16:57:37.113227 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:37.113427 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.108104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:41341 (local address 127.7.153.1:55953)
0806 16:57:37.108311 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.108327 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:37.108431 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:37.108755 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:37.108761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:37.108788 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:37.108936 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.108945 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.109998 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.110001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.111625 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.111637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.112603 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.112607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.112936 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.113021 (+ 85us) client_negotiation.cc:769] Sending connection context
0806 16:57:37.113111 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 16:57:37.113259 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":232}
I20260806 16:57:37.113436 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.108104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34463 (local address 127.7.153.1:40787)
0806 16:57:37.108664 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.108698 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:37.108854 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:37.109146 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:37.109148 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:37.109166 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:37.109264 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.109269 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.110171 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.110175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.111625 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:37.111637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.112603 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.112607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:37.112937 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.113021 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 16:57:37.113111 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 16:57:37.113259 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":497,"thread_start_us":143,"threads_started":1}
I20260806 16:57:37.113987 15558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "032f0af2ed4040d29565dba5ddd74764" candidate_uuid: "b9bc767af21e4a588f5e63ff0ee55503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "083e7294b8f24867a8f614cfae4fd209" is_pre_election: true
I20260806 16:57:37.114214 15558 raft_consensus.cc:2454] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9bc767af21e4a588f5e63ff0ee55503 in term 0.
I20260806 16:57:37.114205 15410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "032f0af2ed4040d29565dba5ddd74764" candidate_uuid: "b9bc767af21e4a588f5e63ff0ee55503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658879b124224d9994ce699b7a3a8189" is_pre_election: true
I20260806 16:57:37.114368 15410 raft_consensus.cc:2454] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9bc767af21e4a588f5e63ff0ee55503 in term 0.
I20260806 16:57:37.114769 15189 leader_election.cc:302] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 083e7294b8f24867a8f614cfae4fd209, 658879b124224d9994ce699b7a3a8189, b9bc767af21e4a588f5e63ff0ee55503; no voters:
I20260806 16:57:37.115088 15734 raft_consensus.cc:2781] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:37.115154 15734 raft_consensus.cc:482] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:37.115192 15734 raft_consensus.cc:3037] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:37.116500 15734 raft_consensus.cc:504] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.117149 15734 leader_election.cc:288] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [CANDIDATE]: Term 1 election: Requested vote from peers 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463), 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341)
I20260806 16:57:37.117369 15410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "032f0af2ed4040d29565dba5ddd74764" candidate_uuid: "b9bc767af21e4a588f5e63ff0ee55503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "658879b124224d9994ce699b7a3a8189"
I20260806 16:57:37.117550 15410 raft_consensus.cc:3037] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:37.118619 15410 raft_consensus.cc:2454] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9bc767af21e4a588f5e63ff0ee55503 in term 1.
I20260806 16:57:37.118916 15558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "032f0af2ed4040d29565dba5ddd74764" candidate_uuid: "b9bc767af21e4a588f5e63ff0ee55503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "083e7294b8f24867a8f614cfae4fd209"
I20260806 16:57:37.118984 15192 leader_election.cc:302] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 658879b124224d9994ce699b7a3a8189, b9bc767af21e4a588f5e63ff0ee55503; no voters:
I20260806 16:57:37.119086 15558 raft_consensus.cc:3037] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:37.119206 15734 raft_consensus.cc:2781] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:37.119472 15734 raft_consensus.cc:686] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [term 1 LEADER]: Becoming Leader. State: Replica: b9bc767af21e4a588f5e63ff0ee55503, State: Running, Role: LEADER
I20260806 16:57:37.119786 15734 consensus_queue.cc:237] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } }
I20260806 16:57:37.120615 15558 raft_consensus.cc:2454] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9bc767af21e4a588f5e63ff0ee55503 in term 1.
I20260806 16:57:37.122160 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.120044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:59459)
0806 16:57:37.122004 (+ 1960us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.122083 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1879}
I20260806 16:57:37.122499 14916 catalog_manager.cc:5495] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1). New cstate: current_term: 1 leader_uuid: "b9bc767af21e4a588f5e63ff0ee55503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9bc767af21e4a588f5e63ff0ee55503" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46753 } health_report { overall_health: HEALTHY } } }
I20260806 16:57:37.136279 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.132604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48794 (local address 127.7.153.1:46753)
0806 16:57:37.132766 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:37.132770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:37.132788 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:57:37.132890 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:37.132892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:37.132953 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:37.133080 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:37.133313 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.133831 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.134690 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:37.134912 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:37.135026 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:37.135309 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:37.135867 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:37.135996 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:37.136065 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 16:57:37.136128 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:57:37.139387 15410 raft_consensus.cc:1261] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Refusing update from remote peer b9bc767af21e4a588f5e63ff0ee55503: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:37.139580 15558 raft_consensus.cc:1261] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Refusing update from remote peer b9bc767af21e4a588f5e63ff0ee55503: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:37.140012 15738 consensus_queue.cc:1035] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "658879b124224d9994ce699b7a3a8189" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:37.140180 15734 consensus_queue.cc:1035] T 032f0af2ed4040d29565dba5ddd74764 P b9bc767af21e4a588f5e63ff0ee55503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "083e7294b8f24867a8f614cfae4fd209" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:37.142045 15615 heartbeater.cc:503] Master 127.7.153.61:41475 was elected leader, sending a full tablet report...
I20260806 16:57:37.142876 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.142482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:56701)
0806 16:57:37.142721 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.142788 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
I20260806 16:57:37.143592 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.142836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:58445)
0806 16:57:37.143432 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.143505 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500}
I20260806 16:57:37.146106 15742 mvcc.cc:205] Tried to move back new op lower bound from 7315601232437346304 to 7315601232365326336. Current Snapshot: MvccSnapshot[applied={T|T < 7315601232437346304}]
I20260806 16:57:37.146858 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.146521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:47077)
0806 16:57:37.146706 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.146773 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 16:57:37.147832 15743 mvcc.cc:205] Tried to move back new op lower bound from 7315601232437346304 to 7315601232365326336. Current Snapshot: MvccSnapshot[applied={T|T < 7315601232437346304}]
I20260806 16:57:37.148104 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.147774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.2:47487)
0806 16:57:37.147950 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.148012 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 16:57:37.150216 15744 mvcc.cc:205] Tried to move back new op lower bound from 7315601232437346304 to 7315601232365326336. Current Snapshot: MvccSnapshot[applied={T|T < 7315601232437346304}]
I20260806 16:57:37.150341 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.150041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.3:58307)
0806 16:57:37.150185 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.150257 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 16:57:37.151391 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.151089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33283 (local address 127.7.153.1:46989)
0806 16:57:37.151244 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.151307 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:33283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 16:57:37.158869 14917 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:37.159098 14917 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:37.164006 14917 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1a85c7ac4874212806f83efbd0dd8e6: Sending DeleteTablet for 3 replicas of tablet 032f0af2ed4040d29565dba5ddd74764
I20260806 16:57:37.165150 15388 tablet_service.cc:1514] Processing DeleteTablet for tablet 032f0af2ed4040d29565dba5ddd74764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:37 UTC) from {username='oryx', principal='oryx/127.7.153.61@KRBTEST.COM'} at 127.0.0.1:42560
I20260806 16:57:37.165158 15240 tablet_service.cc:1514] Processing DeleteTablet for tablet 032f0af2ed4040d29565dba5ddd74764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:37 UTC) from {username='oryx', principal='oryx/127.7.153.61@KRBTEST.COM'} at 127.0.0.1:48788
I20260806 16:57:37.165741 15536 tablet_service.cc:1514] Processing DeleteTablet for tablet 032f0af2ed4040d29565dba5ddd74764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:37 UTC) from {username='oryx', principal='oryx/127.7.153.61@KRBTEST.COM'} at 127.0.0.1:53468
I20260806 16:57:37.165902 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 15073
I20260806 16:57:37.165787 15752 tablet_replica.cc:330] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: stopping tablet replica
I20260806 16:57:37.166775 15752 raft_consensus.cc:2229] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:37.167008 15752 raft_consensus.cc:2258] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:37.167900 15752 ts_tablet_manager.cc:1905] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:37.168051 15754 tablet_replica.cc:330] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: stopping tablet replica
I20260806 16:57:37.168233 15754 raft_consensus.cc:2229] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:37.168427 15754 raft_consensus.cc:2258] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:37.169437 15754 ts_tablet_manager.cc:1905] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:37.171577 15754 ts_tablet_manager.cc:1918] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:37.171707 15754 log.cc:1196] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/032f0af2ed4040d29565dba5ddd74764
I20260806 16:57:37.171748 15752 ts_tablet_manager.cc:1918] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:37.171854 15752 log.cc:1196] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/032f0af2ed4040d29565dba5ddd74764
I20260806 16:57:37.172035 15754 ts_tablet_manager.cc:1939] T 032f0af2ed4040d29565dba5ddd74764 P 083e7294b8f24867a8f614cfae4fd209: Deleting consensus metadata
I20260806 16:57:37.172188 15752 ts_tablet_manager.cc:1939] T 032f0af2ed4040d29565dba5ddd74764 P 658879b124224d9994ce699b7a3a8189: Deleting consensus metadata
I20260806 16:57:37.173074 14897 catalog_manager.cc:4841] TS 083e7294b8f24867a8f614cfae4fd209 (127.7.153.3:41341): tablet 032f0af2ed4040d29565dba5ddd74764 (table test-table [id=3ea6a2577bb0462c8e3d78a90144affa]) successfully deleted
I20260806 16:57:37.173182 14903 catalog_manager.cc:4841] TS 658879b124224d9994ce699b7a3a8189 (127.7.153.2:34463): tablet 032f0af2ed4040d29565dba5ddd74764 (table test-table [id=3ea6a2577bb0462c8e3d78a90144affa]) successfully deleted
I20260806 16:57:37.176641 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 15318
I20260806 16:57:37.176765 15719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:37.176405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46753 (local address 127.0.0.1:48796)
0806 16:57:37.176564 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:37.176614 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:46753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 16:57:37.176988 14897 catalog_manager.cc:4584] TS b9bc767af21e4a588f5e63ff0ee55503 (127.7.153.1:46753): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 032f0af2ed4040d29565dba5ddd74764: Network error: Client connection negotiation failed: client connection to 127.7.153.1:46753: connect: Connection refused (error 111)
I20260806 16:57:37.185199 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 15467
I20260806 16:57:37.194818 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14766
I20260806 16:57:37.204336 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 14877
2026-08-06T16:57:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7624 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:37 dist-test-slave-cbsf krb5kdc[15757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:37 dist-test-slave-cbsf krb5kdc[15757](info): set up 2 sockets
Aug 06 16:57:37 dist-test-slave-cbsf krb5kdc[15757](info): commencing operation
krb5kdc: starting...
W20260806 16:57:38.316452 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:38 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab.
Entry for principal oryx/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab.
I20260806 16:57:38.457193 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:46755
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab
--principal=oryx/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:46755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:38.580602 15770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:38.580969 15770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:38.581015 15770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:38.585670 15770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:38.585762 15770 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 16:57:38.585783 15770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:38.585811 15770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:38.585829 15770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:38.585845 15770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:38.591692 15770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:46755
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.62.keytab
--principal=oryx/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:46755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:38.593003 15770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:38.594070 15770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:38.603484 15776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:38.603546 15778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:38.603583 15770 server_base.cc:1034] running on GCE node
W20260806 16:57:38.603518 15775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:38.604417 15770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:38.605777 15770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:38.606989 15770 hybrid_clock.cc:648] HybridClock initialized: now 1786035458606969 us; error 35 us; skew 500 ppm
Aug 06 16:57:38 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035458, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:38.610172 15770 init.cc:377] Logged in from keytab as oryx/127.7.153.62@KRBTEST.COM (short username oryx)
I20260806 16:57:38.611248 15770 webserver.cc:460] Webserver started at http://127.7.153.62:38041/ using document root <none> and password file <none>
I20260806 16:57:38.611905 15770 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:38.612012 15770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:38.612273 15770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:38.614671 15770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "bc148813895b40e4877fa2b5bfa27e8c"
format_stamp: "Formatted at 2026-08-06 16:57:38 on dist-test-slave-cbsf"
server_key: "06b841a97e6c2670ea98dd6d2bcdc571"
server_key_iv: "4457ae44e665058fdaebb65c41d839c6"
server_key_version: "encryptionkey@0"
I20260806 16:57:38.615388 15770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "bc148813895b40e4877fa2b5bfa27e8c"
format_stamp: "Formatted at 2026-08-06 16:57:38 on dist-test-slave-cbsf"
server_key: "06b841a97e6c2670ea98dd6d2bcdc571"
server_key_iv: "4457ae44e665058fdaebb65c41d839c6"
server_key_version: "encryptionkey@0"
I20260806 16:57:38.619736 15770 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 16:57:38.622612 15786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:38.624015 15770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:38.624192 15770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "bc148813895b40e4877fa2b5bfa27e8c"
format_stamp: "Formatted at 2026-08-06 16:57:38 on dist-test-slave-cbsf"
server_key: "06b841a97e6c2670ea98dd6d2bcdc571"
server_key_iv: "4457ae44e665058fdaebb65c41d839c6"
server_key_version: "encryptionkey@0"
I20260806 16:57:38.624330 15770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:38.658187 15770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:38.661984 15770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:38.662169 15770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:38.670692 15770 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:46755
I20260806 16:57:38.670773 15853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:46755 every 8 connection(s)
I20260806 16:57:38.671813 15770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:38.675091 15854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:38.676074 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 15770
I20260806 16:57:38.676237 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:38.676579 7780 external_mini_cluster.cc:1428] Setting key 2c926b8354460c5ac0b2f74701e7ef5b
I20260806 16:57:38.682343 15854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Bootstrap starting.
I20260806 16:57:38.684937 15854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:38.686022 15854 log.cc:824] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Log is configured to *not* fsync() on all Append() calls
Aug 06 16:57:38 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:38.688386 15854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: No bootstrap required, opened a new log
I20260806 16:57:38.691741 15854 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc148813895b40e4877fa2b5bfa27e8c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46755 } }
I20260806 16:57:38.692034 15854 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:38.692121 15854 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc148813895b40e4877fa2b5bfa27e8c, State: Initialized, Role: FOLLOWER
I20260806 16:57:38.692744 15854 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc148813895b40e4877fa2b5bfa27e8c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46755 } }
I20260806 16:57:38.692912 15854 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:38.692981 15854 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:38.693096 15854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:38.693881 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:38.678850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43384 (local address 127.7.153.62:46755)
0806 16:57:38.679379 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:38.679395 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:38.679435 (+ 40us) server_negotiation.cc:407] Connection header received
0806 16:57:38.680129 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:38.680147 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:38.680491 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:38.680936 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:38.681836 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:38.682914 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:38.683824 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:38.684316 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:38.684503 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:38.687677 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:38.687683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:38.687708 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:38.687737 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:38.690301 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:38.690834 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:38.690840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:38.690845 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:38.690966 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:38.691270 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:38.691275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:38.691276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:38.691731 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:38.691963 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:38.692357 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 16:57:38.692714 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":158,"threads_started":1}
I20260806 16:57:38.694535 15854 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc148813895b40e4877fa2b5bfa27e8c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46755 } }
I20260806 16:57:38.694926 15854 leader_election.cc:302] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc148813895b40e4877fa2b5bfa27e8c; no voters:
I20260806 16:57:38.695322 15854 leader_election.cc:288] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:38.695426 15859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:38.695679 15859 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [term 1 LEADER]: Becoming Leader. State: Replica: bc148813895b40e4877fa2b5bfa27e8c, State: Running, Role: LEADER
I20260806 16:57:38.696004 15859 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc148813895b40e4877fa2b5bfa27e8c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46755 } }
I20260806 16:57:38.696797 15854 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:38.697321 15859 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc148813895b40e4877fa2b5bfa27e8c. Latest consensus state: current_term: 1 leader_uuid: "bc148813895b40e4877fa2b5bfa27e8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc148813895b40e4877fa2b5bfa27e8c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46755 } } }
I20260806 16:57:38.697453 15859 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:38.697808 15860 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc148813895b40e4877fa2b5bfa27e8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc148813895b40e4877fa2b5bfa27e8c" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 46755 } } }
I20260806 16:57:38.697928 15860 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:38.699543 15864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:38.702450 15864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:38.708334 15864 catalog_manager.cc:1347] Generated new cluster ID: 4f6ceb7a49884978ac1042a1c90f14f6
I20260806 16:57:38.708442 15864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:38.731340 15864 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:38.732808 15864 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:38.742777 15864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Generated new TSK 0
I20260806 16:57:38.743779 15864 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab.
Entry for principal oryx/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab.
I20260806 16:57:38.786091 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46755
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:38.910540 15883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:38.910904 15883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:38.910992 15883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:38.915805 15883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:38.915947 15883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:38.916035 15883 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:38.916133 15883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:38.922052 15883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:46755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:38.923357 15883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:38.924485 15883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:38.935367 15890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:38.935385 15889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:38.935367 15892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:38.936123 15883 server_base.cc:1034] running on GCE node
I20260806 16:57:38.937009 15883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:38.937891 15883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:38.939096 15883 hybrid_clock.cc:648] HybridClock initialized: now 1786035458939076 us; error 41 us; skew 500 ppm
Aug 06 16:57:38 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035458, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:38.942418 15883 init.cc:377] Logged in from keytab as oryx/127.7.153.1@KRBTEST.COM (short username oryx)
I20260806 16:57:38.943503 15883 webserver.cc:460] Webserver started at http://127.7.153.1:32785/ using document root <none> and password file <none>
I20260806 16:57:38.944157 15883 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:38.944264 15883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:38.944530 15883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:38.946838 15883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "6a3745aebbd9413aaea756a204d3b3b3"
format_stamp: "Formatted at 2026-08-06 16:57:38 on dist-test-slave-cbsf"
server_key: "fbdbb3eac9f811d6b4ae9a83f42db2a7"
server_key_iv: "63831dc98a1da68b84ad10954f35609f"
server_key_version: "encryptionkey@0"
I20260806 16:57:38.947470 15883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "6a3745aebbd9413aaea756a204d3b3b3"
format_stamp: "Formatted at 2026-08-06 16:57:38 on dist-test-slave-cbsf"
server_key: "fbdbb3eac9f811d6b4ae9a83f42db2a7"
server_key_iv: "63831dc98a1da68b84ad10954f35609f"
server_key_version: "encryptionkey@0"
I20260806 16:57:38.951776 15883 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:57:38.954856 15900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:38.956322 15883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:38.956509 15883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "6a3745aebbd9413aaea756a204d3b3b3"
format_stamp: "Formatted at 2026-08-06 16:57:38 on dist-test-slave-cbsf"
server_key: "fbdbb3eac9f811d6b4ae9a83f42db2a7"
server_key_iv: "63831dc98a1da68b84ad10954f35609f"
server_key_version: "encryptionkey@0"
I20260806 16:57:38.956651 15883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:38.971225 15883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:38.975366 15883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:38.975675 15883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:38.977582 15883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:38.977664 15883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:38.977735 15883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:38.977780 15883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:38 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035458, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:38.990298 15883 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:44545
I20260806 16:57:38.990325 16021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:44545 every 8 connection(s)
I20260806 16:57:38.991638 15883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:38.994493 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:38.978437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:49965 (local address 127.7.153.62:46755)
0806 16:57:38.978582 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:38.978586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:38.979793 (+ 1207us) server_negotiation.cc:407] Connection header received
0806 16:57:38.981042 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:38.981046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:38.981143 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:38.981214 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:38.983281 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:38.984057 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:38.985558 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:38.985879 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:38.986020 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:38.989416 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:38.989421 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:38.989424 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:38.989471 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:38.991338 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:38.992113 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:38.992121 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:38.992124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:38.992257 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:38.992793 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:38.992797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:38.992799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:38.993145 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:38.993277 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:38.994045 (+ 768us) server_negotiation.cc:299] Negotiation successful
0806 16:57:38.994239 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 16:57:38.995690 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 15883
I20260806 16:57:38.995831 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:38.996197 7780 external_mini_cluster.cc:1428] Setting key d1f199c0e3d23bfc9e84b0a9de07988d
I20260806 16:57:38.995864 15909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:38.979039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.7.153.1:49965)
0806 16:57:38.979597 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:38.979657 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:38.980740 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:38.981767 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:38.981779 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:38.982347 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:38.983092 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:38.983112 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:38.984215 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:38.984218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:38.985409 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:38.985422 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:38.986089 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:38.986093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:38.986294 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:38.987034 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:38.987054 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:38.989151 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:38.991525 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:38.991534 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:38.991552 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:38.991921 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:38.992399 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:38.992405 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:38.992422 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:38.992635 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:38.993289 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:38.993300 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:38.993707 (+ 407us) client_negotiation.cc:769] Sending connection context
0806 16:57:38.993955 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 16:57:38.994394 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":134,"threads_started":1}
I20260806 16:57:38.999434 16023 heartbeater.cc:347] Connected to a master server at 127.7.153.62:46755
I20260806 16:57:39.000026 16023 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:39.000871 16023 heartbeater.cc:511] Master 127.7.153.62:46755 requested a full tablet report, sending...
I20260806 16:57:39.003875 15805 ts_manager.cc:194] Registered new tserver with Master: 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545)
I20260806 16:57:39.005892 15805 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:49965
WARNING: no policy specified for oryx/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:39.014963 16032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.007042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.7.153.1:39519)
0806 16:57:39.007510 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.007525 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.007666 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.007940 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.007943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.008183 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:39.008287 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.008293 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.009166 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.009169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.009742 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.009750 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.010242 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.010246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.010342 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.010920 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:39.010933 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:39.011267 (+ 334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:39.013248 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.013252 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.013254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.013485 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.013796 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.013800 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.013801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.013895 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.014364 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:39.014367 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:39.014479 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.014594 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.014772 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":279,"threads_started":1}
I20260806 16:57:39.014952 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.007121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:39519 (local address 127.7.153.62:46755)
0806 16:57:39.007239 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.007245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.007617 (+ 372us) server_negotiation.cc:407] Connection header received
0806 16:57:39.007780 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.007783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.007835 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.007919 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.008411 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.009036 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.009870 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.010118 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.010232 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.011494 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.011497 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.011501 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.011535 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.013109 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.013613 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.013617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.013618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.013697 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.013991 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.013996 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.013998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.014266 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.014376 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.014655 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.014780 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab.
Entry for principal oryx/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab.
I20260806 16:57:39.032481 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46755
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:39.155047 16034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:39.155368 16034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:39.155417 16034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:39.159739 16034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:39.159832 16034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:39.159874 16034 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:39.159955 16034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:39.165877 16034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:46755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:39.167184 16034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:39.168236 16034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:39.178959 16042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:39.178962 16041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:39.178962 16044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:39.179024 16034 server_base.cc:1034] running on GCE node
I20260806 16:57:39.179651 16034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:39.180378 16034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:39.181589 16034 hybrid_clock.cc:648] HybridClock initialized: now 1786035459181545 us; error 58 us; skew 500 ppm
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035459, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:39.184868 16034 init.cc:377] Logged in from keytab as oryx/127.7.153.2@KRBTEST.COM (short username oryx)
I20260806 16:57:39.186208 16034 webserver.cc:460] Webserver started at http://127.7.153.2:37937/ using document root <none> and password file <none>
I20260806 16:57:39.186884 16034 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:39.186957 16034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:39.187258 16034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:39.189687 16034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "4c7dbcec620342518dcf5bdea27fba9c"
format_stamp: "Formatted at 2026-08-06 16:57:39 on dist-test-slave-cbsf"
server_key: "0af7651b48b8c5588ef26d0b1599f070"
server_key_iv: "44498eeba0bc358acdec24ff6a008e9c"
server_key_version: "encryptionkey@0"
I20260806 16:57:39.190346 16034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "4c7dbcec620342518dcf5bdea27fba9c"
format_stamp: "Formatted at 2026-08-06 16:57:39 on dist-test-slave-cbsf"
server_key: "0af7651b48b8c5588ef26d0b1599f070"
server_key_iv: "44498eeba0bc358acdec24ff6a008e9c"
server_key_version: "encryptionkey@0"
I20260806 16:57:39.194784 16034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:57:39.197952 16052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:39.199432 16034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:39.199587 16034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "4c7dbcec620342518dcf5bdea27fba9c"
format_stamp: "Formatted at 2026-08-06 16:57:39 on dist-test-slave-cbsf"
server_key: "0af7651b48b8c5588ef26d0b1599f070"
server_key_iv: "44498eeba0bc358acdec24ff6a008e9c"
server_key_version: "encryptionkey@0"
I20260806 16:57:39.199720 16034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:39.217952 16034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:39.221266 16034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:39.221489 16034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:39.223132 16034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:39.223188 16034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:39.223230 16034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:39.223284 16034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035459, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:39.235157 16034 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:42357
I20260806 16:57:39.235193 16174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:42357 every 8 connection(s)
I20260806 16:57:39.236155 16034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:39.238652 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.224028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:55079 (local address 127.7.153.62:46755)
0806 16:57:39.224171 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.224174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.225321 (+ 1147us) server_negotiation.cc:407] Connection header received
0806 16:57:39.226432 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.226437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.226522 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.226599 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.228582 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.229430 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.230771 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.231014 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.231148 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.234283 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.234287 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.234290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.234327 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.235989 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.236616 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.236620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.236622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.236748 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.237571 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.237574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.237575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.237794 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.237885 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.238412 (+ 527us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.238531 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:57:39.239547 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.224602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.7.153.2:55079)
0806 16:57:39.225161 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.225207 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.226145 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.227140 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.227152 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.227661 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:39.228391 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.228417 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.229571 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.229574 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.230614 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.230648 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.231212 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.231216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.231430 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.232167 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:39.232189 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:39.234081 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:39.236140 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.236146 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.236163 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.236504 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.237000 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.237010 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.237016 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.237462 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.237916 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:39.237922 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:39.238186 (+ 264us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.238354 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.238634 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":149,"threads_started":1}
I20260806 16:57:39.241153 16175 heartbeater.cc:347] Connected to a master server at 127.7.153.62:46755
I20260806 16:57:39.241350 16175 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:39.241717 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 16034
I20260806 16:57:39.241838 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:39.242038 16175 heartbeater.cc:511] Master 127.7.153.62:46755 requested a full tablet report, sending...
I20260806 16:57:39.242187 7780 external_mini_cluster.cc:1428] Setting key 20dd4f316292ef72a4d847213fb3da5a
I20260806 16:57:39.243300 15805 ts_manager.cc:194] Registered new tserver with Master: 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357)
I20260806 16:57:39.244091 15805 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:55079
I20260806 16:57:39.251727 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.243574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:34919 (local address 127.7.153.62:46755)
0806 16:57:39.243962 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.243968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.243983 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:39.244023 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.244026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.244070 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.244160 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.244720 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.245497 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.246832 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.247048 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.247145 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.248400 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.248403 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.248405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.248437 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.249925 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.250392 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.250396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.250398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.250485 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.250784 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.250788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.250790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.251039 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.251157 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.251432 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.251551 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299}
I20260806 16:57:39.251744 16181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.243511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.7.153.2:34919)
0806 16:57:39.243798 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.243815 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.243908 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.244202 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.244204 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.244457 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:39.244565 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.244572 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.245668 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.245674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.246696 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.246710 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.247186 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.247191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.247310 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.247876 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:39.247893 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:39.248264 (+ 371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:39.250054 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.250059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.250061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.250286 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.250593 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.250596 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.250598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.250689 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.251147 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:39.251150 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:39.251255 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.251363 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.251539 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for oryx/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab.
Entry for principal oryx/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab.
I20260806 16:57:39.275380 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:46755
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:39.397827 16185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:39.398157 16185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:39.398206 16185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:39.403771 16185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:39.403848 16185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:39.403894 16185 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 16:57:39.403928 16185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:39.409698 16185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.153.62:46755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:39.410876 16185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:39.411899 16185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:39.422465 16193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:39.422459 16191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:39.422487 16190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:39.422917 16185 server_base.cc:1034] running on GCE node
I20260806 16:57:39.423408 16185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:39.424201 16185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:39.425369 16185 hybrid_clock.cc:648] HybridClock initialized: now 1786035459425346 us; error 35 us; skew 500 ppm
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035459, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:39.428576 16185 init.cc:377] Logged in from keytab as oryx/127.7.153.3@KRBTEST.COM (short username oryx)
I20260806 16:57:39.429737 16185 webserver.cc:460] Webserver started at http://127.7.153.3:43975/ using document root <none> and password file <none>
I20260806 16:57:39.430369 16185 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:39.430469 16185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:39.430730 16185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:39.433149 16185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "51fac86d89d24482be323d985882eb79"
format_stamp: "Formatted at 2026-08-06 16:57:39 on dist-test-slave-cbsf"
server_key: "b9069cf2b57b48773cc959ebdb9ffda8"
server_key_iv: "42af42718014264a32fc8dadf56f379b"
server_key_version: "encryptionkey@0"
I20260806 16:57:39.433771 16185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "51fac86d89d24482be323d985882eb79"
format_stamp: "Formatted at 2026-08-06 16:57:39 on dist-test-slave-cbsf"
server_key: "b9069cf2b57b48773cc959ebdb9ffda8"
server_key_iv: "42af42718014264a32fc8dadf56f379b"
server_key_version: "encryptionkey@0"
I20260806 16:57:39.438001 16185 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:39.440807 16201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:39.442283 16185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:39.442445 16185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "51fac86d89d24482be323d985882eb79"
format_stamp: "Formatted at 2026-08-06 16:57:39 on dist-test-slave-cbsf"
server_key: "b9069cf2b57b48773cc959ebdb9ffda8"
server_key_iv: "42af42718014264a32fc8dadf56f379b"
server_key_version: "encryptionkey@0"
I20260806 16:57:39.442610 16185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:39.467410 16185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:39.471269 16185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:39.471513 16185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:39.473318 16185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:39.473402 16185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:39.473480 16185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:39.473537 16185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035459, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:39.485870 16185 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:42563
I20260806 16:57:39.485915 16321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:42563 every 8 connection(s)
I20260806 16:57:39.487221 16185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:39.489511 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.474119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:41965 (local address 127.7.153.62:46755)
0806 16:57:39.474290 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.474297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.475320 (+ 1023us) server_negotiation.cc:407] Connection header received
0806 16:57:39.476778 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.476783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.476860 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.476932 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.479119 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.479895 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.481629 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.481873 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.482007 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.485102 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.485105 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.485107 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.485137 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.486948 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.487698 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.487702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.487707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.487818 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.488254 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.488257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.488259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.488555 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.488648 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.489250 (+ 602us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.489375 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 16:57:39.490432 16210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.474560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.7.153.3:41965)
0806 16:57:39.475094 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.475175 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.476446 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.477477 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.477490 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.478024 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:39.478901 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.478930 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.480177 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.480182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.481479 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.481491 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.482067 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.482071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.482264 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.483013 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:39.483032 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:39.484876 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:39.487143 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.487150 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.487167 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.487551 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.487935 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.487940 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.487942 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.488136 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.488671 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:39.488677 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:39.488997 (+ 320us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.489180 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.489459 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":114,"threads_started":1}
I20260806 16:57:39.491931 16322 heartbeater.cc:347] Connected to a master server at 127.7.153.62:46755
I20260806 16:57:39.492126 16322 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:39.492808 16322 heartbeater.cc:511] Master 127.7.153.62:46755 requested a full tablet report, sending...
I20260806 16:57:39.494210 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 16185
I20260806 16:57:39.494239 15805 ts_manager.cc:194] Registered new tserver with Master: 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:39.494362 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:39.494763 7780 external_mini_cluster.cc:1428] Setting key 932cb6d89f51625d16e373c1f1b5d782
I20260806 16:57:39.494989 15805 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:41965
I20260806 16:57:39.497061 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:57:39.504169 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.494979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.7.153.3:43531)
0806 16:57:39.495362 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.495383 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.495497 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.495926 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.495929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.496198 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:39.496321 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.496329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.497436 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.497439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.498376 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.498387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.498946 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.498950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.499048 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.499679 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:39.499698 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:39.500217 (+ 519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:39.502219 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.502226 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.502231 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.502549 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.502913 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.502918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.502923 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.503046 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.503544 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:39.503549 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:39.503679 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.503802 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.503997 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":198,"threads_started":1}
I20260806 16:57:39.504276 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.494991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:43531 (local address 127.7.153.62:46755)
0806 16:57:39.495726 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.495735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.495746 (+ 11us) server_negotiation.cc:407] Connection header received
0806 16:57:39.495777 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.495779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.495814 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.495906 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.496451 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.497235 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.498510 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.498828 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.498940 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.500411 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.500414 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.500416 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.500442 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.502063 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.502670 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.502673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.502674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.502769 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.503157 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.503159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.503161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.503363 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.503536 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.503905 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.504061 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654}
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035459, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
W20260806 16:57:39.526729 15857 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:39.518818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43388 (local address 127.7.153.62:46755)
0806 16:57:39.518958 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.518961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.518974 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:39.519019 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.519021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.519060 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.519183 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.520289 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.521530 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.522571 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.522791 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.522882 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.526592 (+ 3710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43388: BlockingRecv error: recv got EOF from 127.0.0.1:43388 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035459, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:39.537513 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.528543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43398 (local address 127.7.153.62:46755)
0806 16:57:39.528687 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.528722 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.528824 (+ 102us) server_negotiation.cc:407] Connection header received
0806 16:57:39.529003 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.529006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.529056 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.529152 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.529811 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.530342 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.531151 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.531374 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.531494 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.534335 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.534339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.534342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.534372 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.535770 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.536217 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.536220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.536221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.536306 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.536572 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.536575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.536576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.536879 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.536993 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.537279 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.537384 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 16:57:39.541148 15805 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:39.544516 15805 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:39.561568 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.555047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40482 (local address 127.7.153.1:44545)
0806 16:57:39.556272 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.556280 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.556301 (+ 21us) server_negotiation.cc:407] Connection header received
0806 16:57:39.556380 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.556386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.556612 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.556847 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.557207 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.558134 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.559878 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.560798 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.560918 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.561098 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.561289 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.561399 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1104,"thread_start_us":90,"threads_started":1}
I20260806 16:57:39.561657 16350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.554920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44545 (local address 127.0.0.1:40482)
0806 16:57:39.555967 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.556026 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.556150 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.556859 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.556867 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.556898 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.557042 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.557050 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.558258 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.558262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.559734 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.559746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.560932 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.560936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.561053 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.561097 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.561251 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.561428 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":857,"mutex_wait_us":4,"thread_start_us":144,"threads_started":1}
I20260806 16:57:39.561821 16347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.555594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42357 (local address 127.0.0.1:43410)
0806 16:57:39.556504 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.556518 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.556622 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.557458 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.557461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.557479 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.557570 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.557577 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.558776 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.558782 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.559778 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.559789 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.561299 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.561303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.561406 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.561530 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.561601 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.561666 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":856,"mutex_wait_us":1,"thread_start_us":94,"threads_started":1}
I20260806 16:57:39.562336 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.555807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.7.153.2:42357)
0806 16:57:39.556511 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.556526 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.556600 (+ 74us) server_negotiation.cc:407] Connection header received
0806 16:57:39.556953 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.556958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.557179 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.557321 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.557703 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.558662 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.559939 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.560807 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.560933 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.561114 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.562068 (+ 954us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.562186 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":113,"threads_started":1}
I20260806 16:57:39.562336 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.555222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38692 (local address 127.7.153.3:42563)
0806 16:57:39.555642 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.555655 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.556304 (+ 649us) server_negotiation.cc:407] Connection header received
0806 16:57:39.556381 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.556386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.556605 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.556847 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.557265 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.558303 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.560129 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.560974 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.561071 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.561233 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.562107 (+ 874us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.562198 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":112,"threads_started":1}
I20260806 16:57:39.562541 16346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.554932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:42563 (local address 127.0.0.1:38692)
0806 16:57:39.555979 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.556026 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.556163 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.557005 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.557008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.557033 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.557122 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.557127 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.558860 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.558865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.559994 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.560003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.561180 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.561184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.561288 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.561322 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.561395 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.561469 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"mutex_wait_us":29,"thread_start_us":97,"threads_started":1}
I20260806 16:57:39.565304 16104 tablet_service.cc:1467] Processing CreateTablet for tablet bbe4689be90a47f49f4499bad9ca7f17 (DEFAULT_TABLE table=test-table [id=ab898a8f274347929d46c3f52fbd059f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:39.565234 15951 tablet_service.cc:1467] Processing CreateTablet for tablet bbe4689be90a47f49f4499bad9ca7f17 (DEFAULT_TABLE table=test-table [id=ab898a8f274347929d46c3f52fbd059f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:39.565546 16254 tablet_service.cc:1467] Processing CreateTablet for tablet bbe4689be90a47f49f4499bad9ca7f17 (DEFAULT_TABLE table=test-table [id=ab898a8f274347929d46c3f52fbd059f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:39.566447 16254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe4689be90a47f49f4499bad9ca7f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.566447 15951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe4689be90a47f49f4499bad9ca7f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.566448 16104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe4689be90a47f49f4499bad9ca7f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.573758 16353 tablet_bootstrap.cc:492] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Bootstrap starting.
I20260806 16:57:39.575239 16355 tablet_bootstrap.cc:492] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Bootstrap starting.
I20260806 16:57:39.575239 16354 tablet_bootstrap.cc:492] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Bootstrap starting.
I20260806 16:57:39.576393 16353 tablet_bootstrap.cc:654] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.577432 16353 log.cc:824] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:39.577519 16355 tablet_bootstrap.cc:654] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.577513 16354 tablet_bootstrap.cc:654] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.578367 16354 log.cc:824] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:39.578368 16355 log.cc:824] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:39.579766 16353 tablet_bootstrap.cc:492] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: No bootstrap required, opened a new log
I20260806 16:57:39.580005 16353 ts_tablet_manager.cc:1397] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 16:57:39.580261 16354 tablet_bootstrap.cc:492] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: No bootstrap required, opened a new log
I20260806 16:57:39.580443 16354 ts_tablet_manager.cc:1397] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260806 16:57:39.581153 16355 tablet_bootstrap.cc:492] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: No bootstrap required, opened a new log
I20260806 16:57:39.581339 16355 ts_tablet_manager.cc:1397] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 16:57:39.583448 16353 raft_consensus.cc:348] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.583766 16353 raft_consensus.cc:374] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.583823 16353 raft_consensus.cc:729] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.584357 16353 consensus_queue.cc:260] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.585381 16354 raft_consensus.cc:348] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.585951 16354 raft_consensus.cc:374] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.585686 16355 raft_consensus.cc:348] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.586051 16354 raft_consensus.cc:729] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3745aebbd9413aaea756a204d3b3b3, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.586088 16355 raft_consensus.cc:374] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.586199 16355 raft_consensus.cc:729] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fac86d89d24482be323d985882eb79, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.586207 16353 ts_tablet_manager.cc:1428] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 16:57:39.586598 16175 heartbeater.cc:503] Master 127.7.153.62:46755 was elected leader, sending a full tablet report...
I20260806 16:57:39.586575 16354 consensus_queue.cc:260] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.586575 16355 consensus_queue.cc:260] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.587275 16023 heartbeater.cc:503] Master 127.7.153.62:46755 was elected leader, sending a full tablet report...
I20260806 16:57:39.587615 16354 ts_tablet_manager.cc:1428] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 16:57:39.587623 16355 ts_tablet_manager.cc:1428] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 16:57:39.587968 16322 heartbeater.cc:503] Master 127.7.153.62:46755 was elected leader, sending a full tablet report...
I20260806 16:57:39.626579 16360 raft_consensus.cc:482] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:39.626936 16360 raft_consensus.cc:504] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.628328 16360 leader_election.cc:288] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563), 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357)
I20260806 16:57:39.634043 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.628785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:51727 (local address 127.7.153.2:42357)
0806 16:57:39.628939 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.628945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.629113 (+ 168us) server_negotiation.cc:407] Connection header received
0806 16:57:39.629288 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.629291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.629347 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.629431 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.630055 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.630882 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.632926 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.633434 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.633570 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.633653 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.633849 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.633936 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 16:57:39.634085 16362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.628604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42357 (local address 127.7.153.1:51727)
0806 16:57:39.628980 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.629020 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.629162 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.629461 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.629463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.629505 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.629889 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.629894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.631040 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.631044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.632780 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.632794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.633578 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.633581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.633698 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.633726 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.633812 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.633899 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":230,"spinlock_wait_cycles":33152,"thread_start_us":155,"threads_started":1}
I20260806 16:57:39.634888 16363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.628621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:42563 (local address 127.7.153.1:38491)
0806 16:57:39.629113 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.629125 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.629209 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.629461 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.629463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.629507 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.629886 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.629894 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.631040 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.631044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.632780 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.632794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.634473 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.634476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.634559 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.634580 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.634654 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.634709 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":342,"spinlock_wait_cycles":8448,"thread_start_us":154,"threads_started":1}
I20260806 16:57:39.634922 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.628748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38491 (local address 127.7.153.3:42563)
0806 16:57:39.629056 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.629061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.629203 (+ 142us) server_negotiation.cc:407] Connection header received
0806 16:57:39.629296 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.629298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.629354 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.629431 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.630042 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.630882 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.633725 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.634361 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.634463 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.634511 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.634699 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.634784 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260806 16:57:39.635123 16127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe4689be90a47f49f4499bad9ca7f17" candidate_uuid: "6a3745aebbd9413aaea756a204d3b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7dbcec620342518dcf5bdea27fba9c" is_pre_election: true
I20260806 16:57:39.635479 16127 raft_consensus.cc:2454] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3745aebbd9413aaea756a204d3b3b3 in term 0.
I20260806 16:57:39.635805 16275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe4689be90a47f49f4499bad9ca7f17" candidate_uuid: "6a3745aebbd9413aaea756a204d3b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79" is_pre_election: true
I20260806 16:57:39.636087 16275 raft_consensus.cc:2454] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3745aebbd9413aaea756a204d3b3b3 in term 0.
I20260806 16:57:39.636078 15904 leader_election.cc:302] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 6a3745aebbd9413aaea756a204d3b3b3; no voters:
I20260806 16:57:39.636474 16360 raft_consensus.cc:2781] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:39.636579 16360 raft_consensus.cc:482] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:39.636624 16360 raft_consensus.cc:3037] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:39.637781 16360 raft_consensus.cc:504] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.638170 16360 leader_election.cc:288] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [CANDIDATE]: Term 1 election: Requested vote from peers 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563), 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357)
I20260806 16:57:39.638516 16275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe4689be90a47f49f4499bad9ca7f17" candidate_uuid: "6a3745aebbd9413aaea756a204d3b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79"
I20260806 16:57:39.638676 16275 raft_consensus.cc:3037] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:39.638669 16127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe4689be90a47f49f4499bad9ca7f17" candidate_uuid: "6a3745aebbd9413aaea756a204d3b3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7dbcec620342518dcf5bdea27fba9c"
I20260806 16:57:39.638829 16127 raft_consensus.cc:3037] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:39.639839 16275 raft_consensus.cc:2454] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3745aebbd9413aaea756a204d3b3b3 in term 1.
I20260806 16:57:39.640640 16127 raft_consensus.cc:2454] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3745aebbd9413aaea756a204d3b3b3 in term 1.
I20260806 16:57:39.641121 15904 leader_election.cc:302] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79, 6a3745aebbd9413aaea756a204d3b3b3; no voters:
I20260806 16:57:39.641453 16360 raft_consensus.cc:2781] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:39.641734 16360 raft_consensus.cc:686] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 LEADER]: Becoming Leader. State: Replica: 6a3745aebbd9413aaea756a204d3b3b3, State: Running, Role: LEADER
I20260806 16:57:39.642161 16360 consensus_queue.cc:237] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } }
I20260806 16:57:39.646440 15805 catalog_manager.cc:5495] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1). New cstate: current_term: 1 leader_uuid: "6a3745aebbd9413aaea756a204d3b3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:39.664868 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.661245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40498 (local address 127.7.153.1:44545)
0806 16:57:39.661394 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.661398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.661413 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:39.661529 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.661532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.661590 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.661694 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:39.661934 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.662433 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.663290 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.663518 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.663631 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.663911 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:39.664412 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:39.664501 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.664584 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.664653 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 16:57:39.671221 16127 raft_consensus.cc:1261] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Refusing update from remote peer 6a3745aebbd9413aaea756a204d3b3b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:39.671747 16275 raft_consensus.cc:1261] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Refusing update from remote peer 6a3745aebbd9413aaea756a204d3b3b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:39.672016 16360 consensus_queue.cc:1035] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:39.672369 16364 consensus_queue.cc:1035] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:39.680779 16368 mvcc.cc:205] Tried to move back new op lower bound from 7315601242805747712 to 7315601242697437184. Current Snapshot: MvccSnapshot[applied={T|T < 7315601242805747712}]
I20260806 16:57:39.685925 16370 mvcc.cc:205] Tried to move back new op lower bound from 7315601242805747712 to 7315601242697437184. Current Snapshot: MvccSnapshot[applied={T|T < 7315601242805747712}]
I20260806 16:57:39.691028 15805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:39.691231 15805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:39.694087 15805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Sending DeleteTablet for 3 replicas of tablet bbe4689be90a47f49f4499bad9ca7f17
I20260806 16:57:39.695019 15951 tablet_service.cc:1514] Processing DeleteTablet for tablet bbe4689be90a47f49f4499bad9ca7f17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:39 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40482
I20260806 16:57:39.695024 16104 tablet_service.cc:1514] Processing DeleteTablet for tablet bbe4689be90a47f49f4499bad9ca7f17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:39 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43410
I20260806 16:57:39.695598 16254 tablet_service.cc:1514] Processing DeleteTablet for tablet bbe4689be90a47f49f4499bad9ca7f17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:39 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38692
I20260806 16:57:39.696089 16381 tablet_replica.cc:330] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: stopping tablet replica
I20260806 16:57:39.696339 16379 tablet_replica.cc:330] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: stopping tablet replica
I20260806 16:57:39.696476 16381 raft_consensus.cc:2229] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:39.696605 16379 raft_consensus.cc:2229] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:39.696913 16379 raft_consensus.cc:2258] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:39.696913 16381 raft_consensus.cc:2258] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:39.697822 15805 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:39.698342 15805 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:39.698854 16381 ts_tablet_manager.cc:1905] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:39.700111 16379 ts_tablet_manager.cc:1905] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:39.702446 16381 ts_tablet_manager.cc:1918] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:39.702555 16381 log.cc:1196] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/bbe4689be90a47f49f4499bad9ca7f17
I20260806 16:57:39.702895 16381 ts_tablet_manager.cc:1939] T bbe4689be90a47f49f4499bad9ca7f17 P 51fac86d89d24482be323d985882eb79: Deleting consensus metadata
I20260806 16:57:39.703187 16380 tablet_replica.cc:330] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: stopping tablet replica
I20260806 16:57:39.703528 16380 raft_consensus.cc:2229] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:39.703900 16380 raft_consensus.cc:2258] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:39.704396 15788 catalog_manager.cc:4841] TS 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563): tablet bbe4689be90a47f49f4499bad9ca7f17 (table test-table [id=ab898a8f274347929d46c3f52fbd059f]) successfully deleted
I20260806 16:57:39.704541 16379 ts_tablet_manager.cc:1918] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:39.704644 16379 log.cc:1196] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/bbe4689be90a47f49f4499bad9ca7f17
I20260806 16:57:39.705031 16379 ts_tablet_manager.cc:1939] T bbe4689be90a47f49f4499bad9ca7f17 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting consensus metadata
I20260806 16:57:39.706647 16254 tablet_service.cc:1467] Processing CreateTablet for tablet 3884cd6b03f64f9aadfeb192e80fd0df (DEFAULT_TABLE table=test-table [id=57c91f98ff8e484d9d2ccc442d0ae6f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:39.706777 15951 tablet_service.cc:1467] Processing CreateTablet for tablet 3884cd6b03f64f9aadfeb192e80fd0df (DEFAULT_TABLE table=test-table [id=57c91f98ff8e484d9d2ccc442d0ae6f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:39.706825 16104 tablet_service.cc:1467] Processing CreateTablet for tablet 3884cd6b03f64f9aadfeb192e80fd0df (DEFAULT_TABLE table=test-table [id=57c91f98ff8e484d9d2ccc442d0ae6f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:39.706959 16254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3884cd6b03f64f9aadfeb192e80fd0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.707017 15951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3884cd6b03f64f9aadfeb192e80fd0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.707139 16104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3884cd6b03f64f9aadfeb192e80fd0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.709676 16354 tablet_bootstrap.cc:492] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Bootstrap starting.
I20260806 16:57:39.709867 16353 tablet_bootstrap.cc:492] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Bootstrap starting.
I20260806 16:57:39.710685 16354 tablet_bootstrap.cc:654] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.711032 16353 tablet_bootstrap.cc:654] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.711328 16355 tablet_bootstrap.cc:492] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Bootstrap starting.
I20260806 16:57:39.712374 16355 tablet_bootstrap.cc:654] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.712502 16353 tablet_bootstrap.cc:492] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: No bootstrap required, opened a new log
I20260806 16:57:39.712604 16353 ts_tablet_manager.cc:1397] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:39.713169 16353 raft_consensus.cc:348] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.713311 16353 raft_consensus.cc:374] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.713354 16353 raft_consensus.cc:729] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.713495 16353 consensus_queue.cc:260] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.714246 16380 ts_tablet_manager.cc:1905] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:39.714543 16353 ts_tablet_manager.cc:1428] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 16:57:39.716593 16380 ts_tablet_manager.cc:1918] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:39.716836 16380 log.cc:1196] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/bbe4689be90a47f49f4499bad9ca7f17
I20260806 16:57:39.717113 15790 catalog_manager.cc:4841] TS 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357): tablet bbe4689be90a47f49f4499bad9ca7f17 (table test-table [id=ab898a8f274347929d46c3f52fbd059f]) successfully deleted
I20260806 16:57:39.717226 16380 ts_tablet_manager.cc:1939] T bbe4689be90a47f49f4499bad9ca7f17 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting consensus metadata
I20260806 16:57:39.718483 16354 tablet_bootstrap.cc:492] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: No bootstrap required, opened a new log
I20260806 16:57:39.718586 16354 ts_tablet_manager.cc:1397] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260806 16:57:39.718803 15789 catalog_manager.cc:4841] TS 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545): tablet bbe4689be90a47f49f4499bad9ca7f17 (table test-table [id=ab898a8f274347929d46c3f52fbd059f]) successfully deleted
I20260806 16:57:39.719244 16354 raft_consensus.cc:348] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.719415 16354 raft_consensus.cc:374] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.719449 16354 raft_consensus.cc:729] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3745aebbd9413aaea756a204d3b3b3, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.720129 16355 tablet_bootstrap.cc:492] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: No bootstrap required, opened a new log
I20260806 16:57:39.720244 16355 ts_tablet_manager.cc:1397] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260806 16:57:39.720770 16355 raft_consensus.cc:348] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.720888 16355 raft_consensus.cc:374] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.720918 16355 raft_consensus.cc:729] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fac86d89d24482be323d985882eb79, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.721095 16354 consensus_queue.cc:260] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.721417 16354 ts_tablet_manager.cc:1428] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:39.721592 16355 consensus_queue.cc:260] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.721952 16355 ts_tablet_manager.cc:1428] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260806 16:57:39.737562 16176 tablet.cc:2369] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:57:39.738413 16323 tablet.cc:2369] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:57:39.743418 16024 tablet.cc:2369] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:57:39.782352 16359 raft_consensus.cc:482] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:39.782552 16359 raft_consensus.cc:504] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.784170 16359 leader_election.cc:288] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:39.789235 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.784459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:42563 (local address 127.7.153.2:37317)
0806 16:57:39.784881 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.784898 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.785017 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.785316 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.785319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.785340 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.785486 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.785492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.786554 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.786557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.787805 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.787817 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.788642 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.788646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.788835 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.788885 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.788974 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.789056 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":34,"thread_start_us":95,"threads_started":1}
I20260806 16:57:39.789254 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.784859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:37317 (local address 127.7.153.3:42563)
0806 16:57:39.784999 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.785003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.785025 (+ 22us) server_negotiation.cc:407] Connection header received
0806 16:57:39.785131 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.785135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.785192 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.785289 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.785618 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.786406 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.787930 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.788504 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.788606 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.788681 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.789009 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.789110 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 16:57:39.789310 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.784595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:45405 (local address 127.7.153.1:44545)
0806 16:57:39.784828 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.784834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.785189 (+ 355us) server_negotiation.cc:407] Connection header received
0806 16:57:39.785369 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.785372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.785420 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.785473 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:39.786172 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.786832 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.787867 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.788488 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.788606 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.788682 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.789119 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.789200 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260806 16:57:39.789690 16386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.784459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44545 (local address 127.7.153.2:45405)
0806 16:57:39.785089 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.785104 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.785223 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.785895 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.785900 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.785925 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:39.786040 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.786046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.786989 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.786992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.787737 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.787745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.788777 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.788781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.788939 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.788991 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.789487 (+ 496us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.789566 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":241,"thread_start_us":75,"threads_started":1}
I20260806 16:57:39.790395 15973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3884cd6b03f64f9aadfeb192e80fd0df" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3" is_pre_election: true
I20260806 16:57:39.790395 16275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3884cd6b03f64f9aadfeb192e80fd0df" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79" is_pre_election: true
I20260806 16:57:39.790573 16275 raft_consensus.cc:2454] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 0.
I20260806 16:57:39.790630 15973 raft_consensus.cc:2454] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 0.
I20260806 16:57:39.791118 16056 leader_election.cc:302] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79, 6a3745aebbd9413aaea756a204d3b3b3; no voters:
I20260806 16:57:39.791424 16359 raft_consensus.cc:2781] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:39.791487 16359 raft_consensus.cc:482] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:39.791533 16359 raft_consensus.cc:3037] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:39.793032 16359 raft_consensus.cc:504] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.793483 16359 leader_election.cc:288] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 election: Requested vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:39.793866 16275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3884cd6b03f64f9aadfeb192e80fd0df" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79"
I20260806 16:57:39.793864 15973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3884cd6b03f64f9aadfeb192e80fd0df" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3"
I20260806 16:57:39.794013 15973 raft_consensus.cc:3037] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:39.794014 16275 raft_consensus.cc:3037] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:39.794983 16275 raft_consensus.cc:2454] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 1.
I20260806 16:57:39.795233 15973 raft_consensus.cc:2454] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 1.
I20260806 16:57:39.795351 16054 leader_election.cc:302] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79; no voters:
I20260806 16:57:39.795578 16359 raft_consensus.cc:2781] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:39.795799 16359 raft_consensus.cc:686] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 1 LEADER]: Becoming Leader. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Running, Role: LEADER
I20260806 16:57:39.796051 16359 consensus_queue.cc:237] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.798749 15805 catalog_manager.cc:5495] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2). New cstate: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } health_report { overall_health: UNKNOWN } } }
Aug 06 16:57:39 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035458, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.62@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:39.849476 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.838711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:46755 (local address 127.0.0.1:43414)
0806 16:57:39.839025 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:39.839045 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:39.839169 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:39.839488 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:39.839491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:39.839911 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:39.840008 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.840014 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.841221 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.841224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.841839 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:39.841848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.842532 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.842537 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:39.842630 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.843313 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:39.843325 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:39.845136 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:39.847377 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.847397 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.847404 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.847783 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.848157 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:39.848160 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:39.848162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:39.848245 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:39.848830 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:39.848837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:39.848973 (+ 136us) client_negotiation.cc:769] Sending connection context
0806 16:57:39.849096 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 16:57:39.849252 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":129,"threads_started":1}
I20260806 16:57:39.849526 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:39.838820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.7.153.62:46755)
0806 16:57:39.838984 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:39.838988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:39.839145 (+ 157us) server_negotiation.cc:407] Connection header received
0806 16:57:39.839268 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:39.839272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:39.839326 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:39.839430 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:39.840147 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.841037 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.841977 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:39.842345 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:39.842451 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:39.845306 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:39.845310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:39.845313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:39.845341 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:39.847193 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.847902 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.847908 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.847910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.848032 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:39.848332 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:39.848335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:39.848337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:39.848605 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:39.848742 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:39.849188 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 16:57:39.849331 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 16:57:39.855286 15805 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43414:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 16:57:39.856192 15805 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:39.863747 15951 tablet_service.cc:1467] Processing CreateTablet for tablet 36e23c86101a4e5ebfb32e84b2e8fcd5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8d946adaeac54f5086aac17213fd587b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:39.864018 16104 tablet_service.cc:1467] Processing CreateTablet for tablet 36e23c86101a4e5ebfb32e84b2e8fcd5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8d946adaeac54f5086aac17213fd587b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:39.864276 15951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36e23c86101a4e5ebfb32e84b2e8fcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.864403 16104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36e23c86101a4e5ebfb32e84b2e8fcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.867079 16354 tablet_bootstrap.cc:492] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: Bootstrap starting.
I20260806 16:57:39.867372 16353 tablet_bootstrap.cc:492] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: Bootstrap starting.
I20260806 16:57:39.867625 16254 tablet_service.cc:1467] Processing CreateTablet for tablet 36e23c86101a4e5ebfb32e84b2e8fcd5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8d946adaeac54f5086aac17213fd587b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 16:57:39.868054 16254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36e23c86101a4e5ebfb32e84b2e8fcd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:39.868108 16354 tablet_bootstrap.cc:654] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.868342 16353 tablet_bootstrap.cc:654] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.870000 16353 tablet_bootstrap.cc:492] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: No bootstrap required, opened a new log
I20260806 16:57:39.870110 16353 ts_tablet_manager.cc:1397] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:39.870675 16353 raft_consensus.cc:348] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.870817 16353 raft_consensus.cc:374] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.870854 16353 raft_consensus.cc:729] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.871004 16353 consensus_queue.cc:260] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.871307 16353 ts_tablet_manager.cc:1428] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 16:57:39.871552 16355 tablet_bootstrap.cc:492] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: Bootstrap starting.
I20260806 16:57:39.871546 16359 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:39.871681 16359 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:39.872743 16355 tablet_bootstrap.cc:654] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:39.873011 16354 tablet_bootstrap.cc:492] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: No bootstrap required, opened a new log
I20260806 16:57:39.873116 16354 ts_tablet_manager.cc:1397] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 16:57:39.873633 16354 raft_consensus.cc:348] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.873780 16354 raft_consensus.cc:374] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.873821 16354 raft_consensus.cc:729] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3745aebbd9413aaea756a204d3b3b3, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.873965 16354 consensus_queue.cc:260] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.874152 16355 tablet_bootstrap.cc:492] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: No bootstrap required, opened a new log
I20260806 16:57:39.874233 16355 ts_tablet_manager.cc:1397] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 16:57:39.874251 16354 ts_tablet_manager.cc:1428] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:39.874233 16374 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:39.874452 16374 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:39.874698 16355 raft_consensus.cc:348] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.874830 16355 raft_consensus.cc:374] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:39.874882 16355 raft_consensus.cc:729] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fac86d89d24482be323d985882eb79, State: Initialized, Role: FOLLOWER
I20260806 16:57:39.875022 16355 consensus_queue.cc:260] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:39.875336 16355 ts_tablet_manager.cc:1428] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:39.875290 16361 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:39.875437 16361 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:40.191069 16359 consensus_queue.cc:1035] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.195684 16402 consensus_queue.cc:1035] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.222651 16402 raft_consensus.cc:482] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:40.222826 16402 raft_consensus.cc:504] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.223393 16402 leader_election.cc:288] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:40.224004 15973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36e23c86101a4e5ebfb32e84b2e8fcd5" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3" is_pre_election: true
I20260806 16:57:40.224004 16275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36e23c86101a4e5ebfb32e84b2e8fcd5" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79" is_pre_election: true
I20260806 16:57:40.224174 15973 raft_consensus.cc:2454] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 0.
I20260806 16:57:40.224181 16275 raft_consensus.cc:2454] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 0.
I20260806 16:57:40.224509 16054 leader_election.cc:302] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79; no voters:
I20260806 16:57:40.224713 16402 raft_consensus.cc:2781] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:40.224779 16402 raft_consensus.cc:482] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:40.224838 16402 raft_consensus.cc:3037] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.225888 16402 raft_consensus.cc:504] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.226260 16402 leader_election.cc:288] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 election: Requested vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:40.226688 16275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36e23c86101a4e5ebfb32e84b2e8fcd5" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79"
I20260806 16:57:40.226768 15973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36e23c86101a4e5ebfb32e84b2e8fcd5" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3"
I20260806 16:57:40.226841 16275 raft_consensus.cc:3037] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.226933 15973 raft_consensus.cc:3037] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.227957 16275 raft_consensus.cc:2454] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 1.
I20260806 16:57:40.228117 15973 raft_consensus.cc:2454] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 1.
I20260806 16:57:40.228397 16054 leader_election.cc:302] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79; no voters:
I20260806 16:57:40.228619 16402 raft_consensus.cc:2781] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:40.228737 16402 raft_consensus.cc:686] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 LEADER]: Becoming Leader. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Running, Role: LEADER
I20260806 16:57:40.228881 16402 consensus_queue.cc:237] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.229602 16387 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: TxnStatusTablet state changed. Reason: New leader 4c7dbcec620342518dcf5bdea27fba9c. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.229732 16387 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:40.229954 16407 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 16:57:40.230113 16407 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 16:57:40.230757 15804 catalog_manager.cc:5495] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2). New cstate: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:40.247843 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.242702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42357 (local address 127.0.0.1:43426)
0806 16:57:40.242847 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:40.242863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:40.243000 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:40.243354 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:40.243357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:40.243369 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:40.243490 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.243496 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.244640 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.244644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.245682 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.245695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.246345 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.246350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.246458 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.246526 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.247452 (+ 926us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.247473 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 16:57:40.247551 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 16:57:40.247672 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 16:57:40.247855 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.242451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43426 (local address 127.7.153.2:42357)
0806 16:57:40.242756 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.242768 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.242936 (+ 168us) server_negotiation.cc:407] Connection header received
0806 16:57:40.243166 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.243169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.243226 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.243343 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.243602 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.244494 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.245844 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.246213 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.246315 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.246747 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.247336 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.247461 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.247585 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.247653 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":113,"threads_started":1}
I20260806 16:57:40.251035 16275 raft_consensus.cc:1261] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Refusing update from remote peer 4c7dbcec620342518dcf5bdea27fba9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:40.251024 15973 raft_consensus.cc:1261] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c7dbcec620342518dcf5bdea27fba9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:40.251515 16387 consensus_queue.cc:1035] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.251825 16387 consensus_queue.cc:1035] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.253126 16374 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: TxnStatusTablet state changed. Reason: New leader 4c7dbcec620342518dcf5bdea27fba9c. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.253270 16374 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:40.253466 16361 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: TxnStatusTablet state changed. Reason: New leader 4c7dbcec620342518dcf5bdea27fba9c. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.253587 16361 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:40.255671 16402 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.255802 16402 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:40.256917 16374 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.257045 16374 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 6a3745aebbd9413aaea756a204d3b3b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:40.262437 16387 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.262581 16387 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 4c7dbcec620342518dcf5bdea27fba9c: This TxnStatusTablet replica's current role is: LEADER
I20260806 16:57:40.263634 16361 tablet_replica.cc:439] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } } }
I20260806 16:57:40.263760 16361 tablet_replica.cc:442] T 36e23c86101a4e5ebfb32e84b2e8fcd5 P 51fac86d89d24482be323d985882eb79: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 16:57:40.271641 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.267945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.7.153.2:42357)
0806 16:57:40.268070 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.268077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.268199 (+ 122us) server_negotiation.cc:407] Connection header received
0806 16:57:40.268329 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.268331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.268375 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.268439 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.268819 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.269344 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.270572 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.270786 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.270863 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.271164 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.271236 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.271289 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.271416 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.271468 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 16:57:40.284595 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.279829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:56493 (local address 127.7.153.2:42357)
0806 16:57:40.279953 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.279958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.280209 (+ 251us) server_negotiation.cc:407] Connection header received
0806 16:57:40.280287 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.280289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.280332 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.280401 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.281194 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.281725 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.283006 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.283234 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.283593 (+ 359us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.284111 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.284191 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.284255 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.284406 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.284460 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 16:57:40.284647 16420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.279729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42357 (local address 127.7.153.2:56493)
0806 16:57:40.280064 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:40.280081 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:40.280199 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:40.280431 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:40.280434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:40.280442 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:40.280581 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.280587 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.281836 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.281840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.282878 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.282889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.283749 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.283755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.283867 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.283933 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.284282 (+ 349us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.284288 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 16:57:40.284358 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 16:57:40.284446 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":104,"threads_started":1}
I20260806 16:57:40.335713 15804 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:40.335914 15804 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:40.338672 15804 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Sending DeleteTablet for 3 replicas of tablet 3884cd6b03f64f9aadfeb192e80fd0df
I20260806 16:57:40.339406 16103 tablet_service.cc:1514] Processing DeleteTablet for tablet 3884cd6b03f64f9aadfeb192e80fd0df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43410
I20260806 16:57:40.339411 15951 tablet_service.cc:1514] Processing DeleteTablet for tablet 3884cd6b03f64f9aadfeb192e80fd0df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40482
I20260806 16:57:40.339784 16254 tablet_service.cc:1514] Processing DeleteTablet for tablet 3884cd6b03f64f9aadfeb192e80fd0df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38692
I20260806 16:57:40.339883 16422 tablet_replica.cc:330] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: stopping tablet replica
I20260806 16:57:40.339977 16423 tablet_replica.cc:330] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: stopping tablet replica
I20260806 16:57:40.340031 16422 raft_consensus.cc:2229] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:40.340178 16422 raft_consensus.cc:2258] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.340258 16424 tablet_replica.cc:330] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: stopping tablet replica
I20260806 16:57:40.340369 16424 raft_consensus.cc:2229] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:40.340485 16424 raft_consensus.cc:2258] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.341218 16424 ts_tablet_manager.cc:1905] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.341218 16422 ts_tablet_manager.cc:1905] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.344406 16422 ts_tablet_manager.cc:1918] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:40.344406 16424 ts_tablet_manager.cc:1918] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:40.344491 16422 log.cc:1196] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/3884cd6b03f64f9aadfeb192e80fd0df
I20260806 16:57:40.344491 16424 log.cc:1196] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/3884cd6b03f64f9aadfeb192e80fd0df
I20260806 16:57:40.344807 16424 ts_tablet_manager.cc:1939] T 3884cd6b03f64f9aadfeb192e80fd0df P 51fac86d89d24482be323d985882eb79: Deleting consensus metadata
I20260806 16:57:40.344807 16422 ts_tablet_manager.cc:1939] T 3884cd6b03f64f9aadfeb192e80fd0df P 6a3745aebbd9413aaea756a204d3b3b3: Deleting consensus metadata
I20260806 16:57:40.344969 16423 raft_consensus.cc:2229] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:40.345412 16423 raft_consensus.cc:2258] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.345709 15788 catalog_manager.cc:4841] TS 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563): tablet 3884cd6b03f64f9aadfeb192e80fd0df (table test-table [id=57c91f98ff8e484d9d2ccc442d0ae6f2]) successfully deleted
I20260806 16:57:40.345960 15789 catalog_manager.cc:4841] TS 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545): tablet 3884cd6b03f64f9aadfeb192e80fd0df (table test-table [id=57c91f98ff8e484d9d2ccc442d0ae6f2]) successfully deleted
I20260806 16:57:40.346272 16423 ts_tablet_manager.cc:1905] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.349301 16423 ts_tablet_manager.cc:1918] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:40.349397 16423 log.cc:1196] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/3884cd6b03f64f9aadfeb192e80fd0df
I20260806 16:57:40.349671 16423 ts_tablet_manager.cc:1939] T 3884cd6b03f64f9aadfeb192e80fd0df P 4c7dbcec620342518dcf5bdea27fba9c: Deleting consensus metadata
I20260806 16:57:40.350577 15790 catalog_manager.cc:4841] TS 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357): tablet 3884cd6b03f64f9aadfeb192e80fd0df (table test-table [id=57c91f98ff8e484d9d2ccc442d0ae6f2]) successfully deleted
Aug 06 16:57:40 dist-test-slave-cbsf krb5kdc[15757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 16:57:40 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:40 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
W20260806 16:57:40.374312 16434 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:40.366843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59828 (local address 127.7.153.62:46755)
0806 16:57:40.367139 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.367143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.367163 (+ 20us) server_negotiation.cc:407] Connection header received
0806 16:57:40.367289 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.367293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.367350 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.367464 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:40.368263 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.369123 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.370052 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.370412 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.370529 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.374118 (+ 3589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59828: BlockingRecv error: recv got EOF from 127.0.0.1:59828 (error 108)
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":105,"threads_started":1}
Aug 06 16:57:40 dist-test-slave-cbsf krb5kdc[15757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM
I20260806 16:57:40.387212 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.376467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59834 (local address 127.7.153.62:46755)
0806 16:57:40.376799 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.376805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.377038 (+ 233us) server_negotiation.cc:407] Connection header received
0806 16:57:40.377144 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.377147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.377221 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.377328 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:40.377991 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.378791 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.379651 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.379995 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.380133 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.383131 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:40.383136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:40.383139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:40.383179 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:40.385211 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:40.385783 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:40.385787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:40.385789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:40.385896 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:40.386209 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:40.386213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:40.386215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:40.386482 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:40.386637 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.386866 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.387014 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260806 16:57:40.390565 15804 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:57:40.391132 15804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:40.397034 15951 tablet_service.cc:1467] Processing CreateTablet for tablet fbaee511f5f04777a6a15a78346072e8 (DEFAULT_TABLE table=test-table [id=e6e9c554582a43f0a20602455c92f4a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:40.397481 15951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbaee511f5f04777a6a15a78346072e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:40.397436 16254 tablet_service.cc:1467] Processing CreateTablet for tablet fbaee511f5f04777a6a15a78346072e8 (DEFAULT_TABLE table=test-table [id=e6e9c554582a43f0a20602455c92f4a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:40.397737 16254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbaee511f5f04777a6a15a78346072e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:40.400559 16441 tablet_bootstrap.cc:492] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Bootstrap starting.
I20260806 16:57:40.400918 16103 tablet_service.cc:1467] Processing CreateTablet for tablet fbaee511f5f04777a6a15a78346072e8 (DEFAULT_TABLE table=test-table [id=e6e9c554582a43f0a20602455c92f4a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:40.401299 16103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbaee511f5f04777a6a15a78346072e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:40.401849 16441 tablet_bootstrap.cc:654] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:40.402628 16442 tablet_bootstrap.cc:492] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Bootstrap starting.
I20260806 16:57:40.403698 16442 tablet_bootstrap.cc:654] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:40.404304 16441 tablet_bootstrap.cc:492] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: No bootstrap required, opened a new log
I20260806 16:57:40.404449 16441 ts_tablet_manager.cc:1397] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 16:57:40.405009 16441 raft_consensus.cc:348] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.405298 16441 raft_consensus.cc:374] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:40.405378 16441 raft_consensus.cc:729] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fac86d89d24482be323d985882eb79, State: Initialized, Role: FOLLOWER
I20260806 16:57:40.405604 16441 consensus_queue.cc:260] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.406518 16441 ts_tablet_manager.cc:1428] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260806 16:57:40.407492 16444 tablet_bootstrap.cc:492] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Bootstrap starting.
I20260806 16:57:40.409159 16444 tablet_bootstrap.cc:654] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:40.409691 16442 tablet_bootstrap.cc:492] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: No bootstrap required, opened a new log
I20260806 16:57:40.409852 16442 ts_tablet_manager.cc:1397] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 16:57:40.410367 16442 raft_consensus.cc:348] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.410506 16442 raft_consensus.cc:374] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:40.410537 16442 raft_consensus.cc:729] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3745aebbd9413aaea756a204d3b3b3, State: Initialized, Role: FOLLOWER
I20260806 16:57:40.410697 16442 consensus_queue.cc:260] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.411167 16442 ts_tablet_manager.cc:1428] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:40.412348 16444 tablet_bootstrap.cc:492] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: No bootstrap required, opened a new log
I20260806 16:57:40.412477 16444 ts_tablet_manager.cc:1397] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 16:57:40.412997 16444 raft_consensus.cc:348] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.413136 16444 raft_consensus.cc:374] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:40.413182 16444 raft_consensus.cc:729] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Initialized, Role: FOLLOWER
I20260806 16:57:40.413328 16444 consensus_queue.cc:260] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.413704 16444 ts_tablet_manager.cc:1428] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 16:57:40.602034 16402 raft_consensus.cc:482] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:40.602257 16402 raft_consensus.cc:504] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.602833 16402 leader_election.cc:288] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:40.603271 16274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbaee511f5f04777a6a15a78346072e8" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79" is_pre_election: true
I20260806 16:57:40.603289 15972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbaee511f5f04777a6a15a78346072e8" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3" is_pre_election: true
I20260806 16:57:40.603444 16274 raft_consensus.cc:2454] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 0.
I20260806 16:57:40.603461 15972 raft_consensus.cc:2454] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 0.
I20260806 16:57:40.603780 16056 leader_election.cc:302] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 6a3745aebbd9413aaea756a204d3b3b3; no voters:
I20260806 16:57:40.603981 16402 raft_consensus.cc:2781] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:40.604043 16402 raft_consensus.cc:482] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:40.604103 16402 raft_consensus.cc:3037] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.605367 16402 raft_consensus.cc:504] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.605796 16402 leader_election.cc:288] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 election: Requested vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563)
I20260806 16:57:40.606190 15972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbaee511f5f04777a6a15a78346072e8" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3"
I20260806 16:57:40.606251 16274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbaee511f5f04777a6a15a78346072e8" candidate_uuid: "4c7dbcec620342518dcf5bdea27fba9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51fac86d89d24482be323d985882eb79"
I20260806 16:57:40.606343 15972 raft_consensus.cc:3037] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.606365 16274 raft_consensus.cc:3037] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.607640 16274 raft_consensus.cc:2454] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 1.
I20260806 16:57:40.607640 15972 raft_consensus.cc:2454] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7dbcec620342518dcf5bdea27fba9c in term 1.
I20260806 16:57:40.607975 16056 leader_election.cc:302] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 6a3745aebbd9413aaea756a204d3b3b3; no voters:
I20260806 16:57:40.608156 16402 raft_consensus.cc:2781] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:40.608281 16402 raft_consensus.cc:686] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 LEADER]: Becoming Leader. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Running, Role: LEADER
I20260806 16:57:40.608433 16402 consensus_queue.cc:237] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.610325 15805 catalog_manager.cc:5495] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2). New cstate: current_term: 1 leader_uuid: "4c7dbcec620342518dcf5bdea27fba9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } health_report { overall_health: UNKNOWN } } }
I20260806 16:57:40.655821 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.652546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37068 (local address 127.7.153.2:42357)
0806 16:57:40.652738 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.652743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.652759 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:40.652837 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.652840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.652892 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.652976 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.653254 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.653777 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.654672 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.654896 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.655013 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.655310 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.655390 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.655471 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.655603 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.655665 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 16:57:40.658329 16274 raft_consensus.cc:1261] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Refusing update from remote peer 4c7dbcec620342518dcf5bdea27fba9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:40.658339 15972 raft_consensus.cc:1261] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c7dbcec620342518dcf5bdea27fba9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:40.658846 16387 consensus_queue.cc:1035] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.659017 16402 consensus_queue.cc:1035] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.662808 16403 mvcc.cc:205] Tried to move back new op lower bound from 7315601246851801088 to 7315601246653923328. Current Snapshot: MvccSnapshot[applied={T|T < 7315601246851801088}]
I20260806 16:57:40.668465 15804 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:40.668642 15804 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:40.670994 15804 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Sending DeleteTablet for 3 replicas of tablet fbaee511f5f04777a6a15a78346072e8
I20260806 16:57:40.671706 15951 tablet_service.cc:1514] Processing DeleteTablet for tablet fbaee511f5f04777a6a15a78346072e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40482
I20260806 16:57:40.671901 16422 tablet_replica.cc:330] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: stopping tablet replica
I20260806 16:57:40.672019 16422 raft_consensus.cc:2229] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:40.672156 16422 raft_consensus.cc:2258] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.672506 15804 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 16:57:40.672923 16422 ts_tablet_manager.cc:1905] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 16:57:40.672973 15804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:57:40.675650 16422 ts_tablet_manager.cc:1918] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:40.675748 16422 log.cc:1196] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/fbaee511f5f04777a6a15a78346072e8
I20260806 16:57:40.676025 16422 ts_tablet_manager.cc:1939] T fbaee511f5f04777a6a15a78346072e8 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting consensus metadata
I20260806 16:57:40.676797 15789 catalog_manager.cc:4841] TS 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545): tablet fbaee511f5f04777a6a15a78346072e8 (table test-table [id=e6e9c554582a43f0a20602455c92f4a7]) successfully deleted
I20260806 16:57:40.676976 16103 tablet_service.cc:1514] Processing DeleteTablet for tablet fbaee511f5f04777a6a15a78346072e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43410
I20260806 16:57:40.677485 16423 tablet_replica.cc:330] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: stopping tablet replica
I20260806 16:57:40.677644 16423 raft_consensus.cc:2229] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:40.677908 16423 raft_consensus.cc:2258] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.678126 16254 tablet_service.cc:1514] Processing DeleteTablet for tablet fbaee511f5f04777a6a15a78346072e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38692
I20260806 16:57:40.678445 16424 tablet_replica.cc:330] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: stopping tablet replica
I20260806 16:57:40.678414 15951 tablet_service.cc:1467] Processing CreateTablet for tablet 80ea1b1115ff475594da82cd94736b14 (DEFAULT_TABLE table=test-table [id=27c4738624e44b9989834e7b25bb1b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:40.678567 16424 raft_consensus.cc:2229] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:40.678710 15951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80ea1b1115ff475594da82cd94736b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:40.678707 16424 raft_consensus.cc:2258] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.679345 16424 ts_tablet_manager.cc:1905] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.679625 16103 tablet_service.cc:1467] Processing CreateTablet for tablet 80ea1b1115ff475594da82cd94736b14 (DEFAULT_TABLE table=test-table [id=27c4738624e44b9989834e7b25bb1b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:40.679898 16103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80ea1b1115ff475594da82cd94736b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:40.681231 16442 tablet_bootstrap.cc:492] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Bootstrap starting.
I20260806 16:57:40.681700 16424 ts_tablet_manager.cc:1918] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:40.681775 16424 log.cc:1196] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/fbaee511f5f04777a6a15a78346072e8
I20260806 16:57:40.682082 16424 ts_tablet_manager.cc:1939] T fbaee511f5f04777a6a15a78346072e8 P 51fac86d89d24482be323d985882eb79: Deleting consensus metadata
I20260806 16:57:40.682237 16442 tablet_bootstrap.cc:654] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:40.682503 16444 tablet_bootstrap.cc:492] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Bootstrap starting.
I20260806 16:57:40.679320 16254 tablet_service.cc:1467] Processing CreateTablet for tablet 80ea1b1115ff475594da82cd94736b14 (DEFAULT_TABLE table=test-table [id=27c4738624e44b9989834e7b25bb1b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:57:40.682832 16254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80ea1b1115ff475594da82cd94736b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:40.683274 16444 tablet_bootstrap.cc:654] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:40.684514 16444 tablet_bootstrap.cc:492] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: No bootstrap required, opened a new log
I20260806 16:57:40.684610 16444 ts_tablet_manager.cc:1397] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 16:57:40.685030 16444 raft_consensus.cc:348] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.685145 16444 raft_consensus.cc:374] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:40.685173 16444 raft_consensus.cc:729] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7dbcec620342518dcf5bdea27fba9c, State: Initialized, Role: FOLLOWER
I20260806 16:57:40.685228 16441 tablet_bootstrap.cc:492] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Bootstrap starting.
I20260806 16:57:40.685300 16444 consensus_queue.cc:260] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.685590 16444 ts_tablet_manager.cc:1428] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 16:57:40.686116 15788 catalog_manager.cc:4841] TS 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563): tablet fbaee511f5f04777a6a15a78346072e8 (table test-table [id=e6e9c554582a43f0a20602455c92f4a7]) successfully deleted
I20260806 16:57:40.686233 16441 tablet_bootstrap.cc:654] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:40.687309 16442 tablet_bootstrap.cc:492] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: No bootstrap required, opened a new log
I20260806 16:57:40.687413 16442 ts_tablet_manager.cc:1397] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 16:57:40.687842 16442 raft_consensus.cc:348] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.687968 16442 raft_consensus.cc:374] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:40.688007 16442 raft_consensus.cc:729] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3745aebbd9413aaea756a204d3b3b3, State: Initialized, Role: FOLLOWER
I20260806 16:57:40.688161 16442 consensus_queue.cc:260] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.688457 16442 ts_tablet_manager.cc:1428] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:40.689225 16423 ts_tablet_manager.cc:1905] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.689682 16441 tablet_bootstrap.cc:492] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: No bootstrap required, opened a new log
I20260806 16:57:40.689754 16441 ts_tablet_manager.cc:1397] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 16:57:40.690140 16441 raft_consensus.cc:348] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.690223 16441 raft_consensus.cc:374] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:40.690243 16441 raft_consensus.cc:729] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fac86d89d24482be323d985882eb79, State: Initialized, Role: FOLLOWER
I20260806 16:57:40.690387 16441 consensus_queue.cc:260] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.690672 16441 ts_tablet_manager.cc:1428] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 16:57:40.691910 16423 ts_tablet_manager.cc:1918] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:57:40.692006 16423 log.cc:1196] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/fbaee511f5f04777a6a15a78346072e8
I20260806 16:57:40.692318 16423 ts_tablet_manager.cc:1939] T fbaee511f5f04777a6a15a78346072e8 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting consensus metadata
I20260806 16:57:40.693102 15790 catalog_manager.cc:4841] TS 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357): tablet fbaee511f5f04777a6a15a78346072e8 (table test-table [id=e6e9c554582a43f0a20602455c92f4a7]) successfully deleted
I20260806 16:57:40.848024 16361 raft_consensus.cc:482] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:57:40.848233 16361 raft_consensus.cc:504] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.849862 16361 leader_election.cc:288] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357)
I20260806 16:57:40.856051 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.850382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:41375 (local address 127.7.153.2:42357)
0806 16:57:40.850523 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.850528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.851160 (+ 632us) server_negotiation.cc:407] Connection header received
0806 16:57:40.851307 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.851311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.851362 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.851441 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:40.851803 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.852529 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.854607 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.855263 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.855382 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.855457 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.855772 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.855875 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 16:57:40.856076 16457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.850450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:40959 (local address 127.7.153.1:44545)
0806 16:57:40.850737 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.850742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.850981 (+ 239us) server_negotiation.cc:407] Connection header received
0806 16:57:40.851049 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.851052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.851114 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.851205 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:57:40.851624 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.852495 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.854590 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.855266 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.855382 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.855458 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.855861 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.855955 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":76,"threads_started":1}
I20260806 16:57:40.856094 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.850292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44545 (local address 127.7.153.3:40959)
0806 16:57:40.850694 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:40.850711 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:40.850876 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:40.851338 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:40.851341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:40.851361 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:40.851506 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.851517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.852719 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.852725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.854409 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.854423 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.855524 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.855528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.855699 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.855726 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:57:40.855825 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 16:57:40.855912 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":58,"thread_start_us":102,"threads_started":1}
I20260806 16:57:40.856604 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.850293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42357 (local address 127.7.153.3:41375)
0806 16:57:40.851040 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:40.851056 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:40.851196 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:40.851485 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:40.851488 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:40.851514 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:57:40.851664 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.851673 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.852741 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.852745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.854425 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.854439 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.855415 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.855419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.855580 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.855617 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 16:57:40.856256 (+ 639us) client_negotiation.cc:240] Negotiation successful
0806 16:57:40.856370 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":525,"thread_start_us":55,"threads_started":1}
I20260806 16:57:40.857190 16127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80ea1b1115ff475594da82cd94736b14" candidate_uuid: "51fac86d89d24482be323d985882eb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7dbcec620342518dcf5bdea27fba9c" is_pre_election: true
I20260806 16:57:40.857398 16127 raft_consensus.cc:2454] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51fac86d89d24482be323d985882eb79 in term 0.
I20260806 16:57:40.857743 15972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80ea1b1115ff475594da82cd94736b14" candidate_uuid: "51fac86d89d24482be323d985882eb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3" is_pre_election: true
I20260806 16:57:40.857878 16205 leader_election.cc:302] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79; no voters:
I20260806 16:57:40.857965 15972 raft_consensus.cc:2454] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51fac86d89d24482be323d985882eb79 in term 0.
I20260806 16:57:40.858256 16361 raft_consensus.cc:2781] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:57:40.858327 16361 raft_consensus.cc:482] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:57:40.858381 16361 raft_consensus.cc:3037] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.859838 16361 raft_consensus.cc:504] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.860265 16361 leader_election.cc:288] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [CANDIDATE]: Term 1 election: Requested vote from peers 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545), 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357)
I20260806 16:57:40.860773 16127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80ea1b1115ff475594da82cd94736b14" candidate_uuid: "51fac86d89d24482be323d985882eb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7dbcec620342518dcf5bdea27fba9c"
I20260806 16:57:40.860773 15972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80ea1b1115ff475594da82cd94736b14" candidate_uuid: "51fac86d89d24482be323d985882eb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3745aebbd9413aaea756a204d3b3b3"
I20260806 16:57:40.860911 15972 raft_consensus.cc:3037] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.860911 16127 raft_consensus.cc:3037] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:40.862130 16127 raft_consensus.cc:2454] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51fac86d89d24482be323d985882eb79 in term 1.
I20260806 16:57:40.862130 15972 raft_consensus.cc:2454] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51fac86d89d24482be323d985882eb79 in term 1.
I20260806 16:57:40.862459 16205 leader_election.cc:302] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7dbcec620342518dcf5bdea27fba9c, 51fac86d89d24482be323d985882eb79; no voters:
I20260806 16:57:40.862701 16361 raft_consensus.cc:2781] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:40.862946 16361 raft_consensus.cc:686] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 1 LEADER]: Becoming Leader. State: Replica: 51fac86d89d24482be323d985882eb79, State: Running, Role: LEADER
I20260806 16:57:40.863245 16361 consensus_queue.cc:237] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } }
I20260806 16:57:40.865937 15805 catalog_manager.cc:5495] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51fac86d89d24482be323d985882eb79 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "51fac86d89d24482be323d985882eb79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51fac86d89d24482be323d985882eb79" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 42563 } health_report { overall_health: HEALTHY } } }
I20260806 16:57:40.896214 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.892143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.7.153.3:42563)
0806 16:57:40.892502 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.892511 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.892526 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:40.892619 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.892621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.892678 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.892858 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.893142 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.893768 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.894663 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.894914 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.895009 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.895282 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.895811 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.895904 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.896010 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.896066 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":170,"threads_started":1}
I20260806 16:57:40.908354 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.904619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:55155 (local address 127.7.153.2:42357)
0806 16:57:40.904801 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.904805 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.904933 (+ 128us) server_negotiation.cc:407] Connection header received
0806 16:57:40.905115 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.905117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.905163 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.905232 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.905491 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.906007 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.907341 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.907568 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.907652 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.907959 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.908036 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.908090 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.908191 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.908240 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 16:57:40.908404 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.904429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42357 (local address 127.7.153.3:55155)
0806 16:57:40.904844 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:40.904861 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:40.904979 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:40.905271 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:40.905273 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:40.905280 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:40.905398 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.905403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.906108 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.906111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.907211 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.907223 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.907701 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.907704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.907774 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.907829 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.908108 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.908113 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 16:57:40.908165 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 16:57:40.908234 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":111,"threads_started":1}
I20260806 16:57:40.915198 16127 raft_consensus.cc:1261] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Refusing update from remote peer 51fac86d89d24482be323d985882eb79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:40.915679 15972 raft_consensus.cc:1261] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Refusing update from remote peer 51fac86d89d24482be323d985882eb79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:57:40.915832 16459 consensus_queue.cc:1035] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c7dbcec620342518dcf5bdea27fba9c" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.916118 16361 consensus_queue.cc:1035] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3745aebbd9413aaea756a204d3b3b3" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:57:40.936267 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.932738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:34157 (local address 127.7.153.3:42563)
0806 16:57:40.932857 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:40.932864 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:40.932879 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:40.932923 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:40.932925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:40.932978 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:40.933069 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:57:40.933331 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.934008 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.935093 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.935373 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.935484 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.935809 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.935907 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.935976 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:40.936094 (+ 118us) server_negotiation.cc:299] Negotiation successful
0806 16:57:40.936153 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 16:57:40.936331 16470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:40.932388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:42563 (local address 127.7.153.2:34157)
0806 16:57:40.932654 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:40.932676 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:40.932811 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:40.933079 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:40.933082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:40.933090 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 16:57:40.933197 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.933203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.934135 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.934139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.934939 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:40.934951 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:40.935523 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:40.935527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:40.935618 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:40.935654 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 16:57:40.935998 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 16:57:40.936006 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 16:57:40.936080 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 16:57:40.936177 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":106,"threads_started":1}
I20260806 16:57:40.962927 15804 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:40.963148 15804 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:57:40.965548 15804 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc148813895b40e4877fa2b5bfa27e8c: Sending DeleteTablet for 3 replicas of tablet 80ea1b1115ff475594da82cd94736b14
I20260806 16:57:40.966306 16103 tablet_service.cc:1514] Processing DeleteTablet for tablet 80ea1b1115ff475594da82cd94736b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43410
I20260806 16:57:40.966354 15951 tablet_service.cc:1514] Processing DeleteTablet for tablet 80ea1b1115ff475594da82cd94736b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40482
I20260806 16:57:40.966499 16254 tablet_service.cc:1514] Processing DeleteTablet for tablet 80ea1b1115ff475594da82cd94736b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:57:40 UTC) from {username='oryx', principal='oryx/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:38692
I20260806 16:57:40.966605 16423 tablet_replica.cc:330] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: stopping tablet replica
I20260806 16:57:40.966701 16424 tablet_replica.cc:330] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: stopping tablet replica
I20260806 16:57:40.966725 16422 tablet_replica.cc:330] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: stopping tablet replica
I20260806 16:57:40.966751 16423 raft_consensus.cc:2229] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:40.966820 16424 raft_consensus.cc:2229] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:57:40.966853 16422 raft_consensus.cc:2229] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:57:40.966884 16423 raft_consensus.cc:2258] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.966964 16422 raft_consensus.cc:2258] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.967177 16424 raft_consensus.cc:2258] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:57:40.967775 16423 ts_tablet_manager.cc:1905] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.967963 16424 ts_tablet_manager.cc:1905] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.968329 16422 ts_tablet_manager.cc:1905] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:57:40.970690 16424 ts_tablet_manager.cc:1918] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:40.970685 16423 ts_tablet_manager.cc:1918] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:40.970782 16424 log.cc:1196] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/80ea1b1115ff475594da82cd94736b14
I20260806 16:57:40.970782 16423 log.cc:1196] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/80ea1b1115ff475594da82cd94736b14
I20260806 16:57:40.971076 16423 ts_tablet_manager.cc:1939] T 80ea1b1115ff475594da82cd94736b14 P 4c7dbcec620342518dcf5bdea27fba9c: Deleting consensus metadata
I20260806 16:57:40.971082 16424 ts_tablet_manager.cc:1939] T 80ea1b1115ff475594da82cd94736b14 P 51fac86d89d24482be323d985882eb79: Deleting consensus metadata
I20260806 16:57:40.971307 16422 ts_tablet_manager.cc:1918] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 16:57:40.971379 16422 log.cc:1196] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/80ea1b1115ff475594da82cd94736b14
I20260806 16:57:40.971652 16422 ts_tablet_manager.cc:1939] T 80ea1b1115ff475594da82cd94736b14 P 6a3745aebbd9413aaea756a204d3b3b3: Deleting consensus metadata
I20260806 16:57:40.971974 15790 catalog_manager.cc:4841] TS 4c7dbcec620342518dcf5bdea27fba9c (127.7.153.2:42357): tablet 80ea1b1115ff475594da82cd94736b14 (table test-table [id=27c4738624e44b9989834e7b25bb1b6d]) successfully deleted
I20260806 16:57:40.972457 15788 catalog_manager.cc:4841] TS 51fac86d89d24482be323d985882eb79 (127.7.153.3:42563): tablet 80ea1b1115ff475594da82cd94736b14 (table test-table [id=27c4738624e44b9989834e7b25bb1b6d]) successfully deleted
I20260806 16:57:40.973093 15789 catalog_manager.cc:4841] TS 6a3745aebbd9413aaea756a204d3b3b3 (127.7.153.1:44545): tablet 80ea1b1115ff475594da82cd94736b14 (table test-table [id=27c4738624e44b9989834e7b25bb1b6d]) successfully deleted
I20260806 16:57:40.974125 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 15883
I20260806 16:57:40.987546 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 16034
I20260806 16:57:41.001341 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 16185
I20260806 16:57:41.010543 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 15770
2026-08-06T16:57:41Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3804 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:41 dist-test-slave-cbsf krb5kdc[16477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:41 dist-test-slave-cbsf krb5kdc[16477](info): set up 2 sockets
Aug 06 16:57:41 dist-test-slave-cbsf krb5kdc[16477](info): commencing operation
krb5kdc: starting...
W20260806 16:57:42.100324 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:42 dist-test-slave-cbsf krb5kdc[16477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:42.246377 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:36503
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:36503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:42.366196 16492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:42.366519 16492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:42.366571 16492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:42.370764 16492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:42.370838 16492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:42.370858 16492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:42.370877 16492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:42.370893 16492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:42.378980 16492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:36503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:36503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:42.380302 16492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:42.381453 16492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:42.390533 16501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:42.390558 16498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:42.390561 16499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:42.391146 16492 server_base.cc:1034] running on GCE node
I20260806 16:57:42.391783 16492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:42.393101 16492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:42.394281 16492 hybrid_clock.cc:648] HybridClock initialized: now 1786035462394263 us; error 61 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T16:57:42Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1386 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:57:42 dist-test-slave-cbsf krb5kdc[16506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:57:42 dist-test-slave-cbsf krb5kdc[16506](info): set up 2 sockets
Aug 06 16:57:42 dist-test-slave-cbsf krb5kdc[16506](info): commencing operation
krb5kdc: starting...
W20260806 16:57:43.513386 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:57:43 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:57:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:57:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:57:43.656461 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:40287
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:40287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:43.779552 16522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:43.779914 16522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:43.780005 16522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:43.784377 16522 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:43.784503 16522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:43.784544 16522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:43.784583 16522 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:43.784621 16522 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:43.790634 16522 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:40287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:40287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:43.791906 16522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:43.793076 16522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:43.802424 16530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:43.802408 16528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:43.802721 16522 server_base.cc:1034] running on GCE node
W20260806 16:57:43.802407 16527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:43.803450 16522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:43.804844 16522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:43.806058 16522 hybrid_clock.cc:648] HybridClock initialized: now 1786035463806037 us; error 38 us; skew 500 ppm
Aug 06 16:57:43 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035463, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:43.814069 16522 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:43.815852 16522 webserver.cc:460] Webserver started at http://127.7.153.62:41539/ using document root <none> and password file <none>
I20260806 16:57:43.816570 16522 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:43.816658 16522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:43.817019 16522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:43.819442 16522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "4939bccc1be34ce49565617a9aa21dc1"
format_stamp: "Formatted at 2026-08-06 16:57:43 on dist-test-slave-cbsf"
server_key: "d4d48c7d66099d30deb1a308ffce0082"
server_key_iv: "0c93d95e62fc8ee1e1a0ad71ddfcdde3"
server_key_version: "encryptionkey@0"
I20260806 16:57:43.820319 16522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "4939bccc1be34ce49565617a9aa21dc1"
format_stamp: "Formatted at 2026-08-06 16:57:43 on dist-test-slave-cbsf"
server_key: "d4d48c7d66099d30deb1a308ffce0082"
server_key_iv: "0c93d95e62fc8ee1e1a0ad71ddfcdde3"
server_key_version: "encryptionkey@0"
I20260806 16:57:43.825253 16522 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:57:43.828297 16537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:43.830087 16522 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:43.830240 16522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "4939bccc1be34ce49565617a9aa21dc1"
format_stamp: "Formatted at 2026-08-06 16:57:43 on dist-test-slave-cbsf"
server_key: "d4d48c7d66099d30deb1a308ffce0082"
server_key_iv: "0c93d95e62fc8ee1e1a0ad71ddfcdde3"
server_key_version: "encryptionkey@0"
I20260806 16:57:43.830432 16522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:43.850688 16522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:43.855185 16522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:43.855386 16522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:43.864749 16522 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:40287
I20260806 16:57:43.864778 16591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:40287 every 8 connection(s)
I20260806 16:57:43.865895 16522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:43.869257 16592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:57:43.875535 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 16522
I20260806 16:57:43.875725 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:57:43.875895 16592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Bootstrap starting.
I20260806 16:57:43.876070 7780 external_mini_cluster.cc:1428] Setting key fefea6574c23b71af49b8922d5e42aa8
I20260806 16:57:43.878965 16592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Neither blocks nor log segments found. Creating new log.
I20260806 16:57:43.880057 16592 log.cc:824] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:43.882612 16592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: No bootstrap required, opened a new log
Aug 06 16:57:43 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:43.887810 16592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:43.888162 16592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:57:43.888226 16592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4939bccc1be34ce49565617a9aa21dc1, State: Initialized, Role: FOLLOWER
I20260806 16:57:43.888813 16592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:43.888985 16592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:43.889077 16592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:43.889178 16592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:57:43.890538 16592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:43.890937 16592 leader_election.cc:302] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4939bccc1be34ce49565617a9aa21dc1; no voters:
I20260806 16:57:43.891336 16592 leader_election.cc:288] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:57:43.891414 16597 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:57:43.891634 16597 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 LEADER]: Becoming Leader. State: Replica: 4939bccc1be34ce49565617a9aa21dc1, State: Running, Role: LEADER
I20260806 16:57:43.891957 16597 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:43.892395 16595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:43.877550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37208 (local address 127.7.153.62:40287)
0806 16:57:43.878034 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:43.878050 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:43.878087 (+ 37us) server_negotiation.cc:407] Connection header received
0806 16:57:43.878773 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:43.878791 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:43.879186 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:43.879502 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:43.880632 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:43.881841 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:43.883082 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:43.883585 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:43.883722 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:43.886663 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:43.886671 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:43.886696 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:43.886735 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:43.888775 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:43.889359 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:43.889365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:43.889372 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:43.889522 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:43.889807 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:43.889810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:43.889812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:43.890410 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:43.890631 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:43.890963 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 16:57:43.891319 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":165,"threads_started":1}
I20260806 16:57:43.892833 16592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:43.893255 16597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4939bccc1be34ce49565617a9aa21dc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } } }
I20260806 16:57:43.893376 16597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:43.893795 16602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:43.893842 16598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4939bccc1be34ce49565617a9aa21dc1. Latest consensus state: current_term: 1 leader_uuid: "4939bccc1be34ce49565617a9aa21dc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } } }
I20260806 16:57:43.894045 16598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:43.897404 16602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:43.903980 16602 catalog_manager.cc:1347] Generated new cluster ID: d8d8d946ab8f4f06af4ff8cd79793463
I20260806 16:57:43.904080 16602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:43.941107 16602 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:57:43.942605 16602 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:43.950402 16602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Generated new TSK 0
I20260806 16:57:43.951288 16602 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:57:43.999991 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:40287
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:44.136345 16621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:44.136740 16621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:44.136821 16621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:44.141131 16621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:44.141223 16621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:44.141287 16621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:44.147311 16621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:40287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:44.148614 16621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:44.149776 16621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:44.160961 16629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:44.161034 16621 server_base.cc:1034] running on GCE node
W20260806 16:57:44.160970 16627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:44.160970 16626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:44.161772 16621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:44.162576 16621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:44.163815 16621 hybrid_clock.cc:648] HybridClock initialized: now 1786035464163786 us; error 44 us; skew 500 ppm
Aug 06 16:57:44 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035464, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:44.167029 16621 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:57:44.168078 16621 webserver.cc:460] Webserver started at http://127.7.153.1:44867/ using document root <none> and password file <none>
I20260806 16:57:44.168680 16621 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:44.168821 16621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:44.169013 16621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:44.171196 16621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "bb80f1fe4d2e4150a2644b6b59566282"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "be865a39c40e046645b2d89bfa40d341"
server_key_iv: "82bbd6d37e3e03b1a5863c55d28f96f9"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.171766 16621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "bb80f1fe4d2e4150a2644b6b59566282"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "be865a39c40e046645b2d89bfa40d341"
server_key_iv: "82bbd6d37e3e03b1a5863c55d28f96f9"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.175983 16621 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 16:57:44.178727 16639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.180203 16621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 16:57:44.180372 16621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "bb80f1fe4d2e4150a2644b6b59566282"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "be865a39c40e046645b2d89bfa40d341"
server_key_iv: "82bbd6d37e3e03b1a5863c55d28f96f9"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.180501 16621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:44.202234 16621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:44.206065 16621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:44.206328 16621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:44.207070 16621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:44.208130 16621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:44.208226 16621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.208315 16621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:44.208376 16621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.219089 16621 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:34493
I20260806 16:57:44.219116 16757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:34493 every 8 connection(s)
I20260806 16:57:44.220171 16621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:44.223338 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 16621
I20260806 16:57:44.223495 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:57:44.223874 7780 external_mini_cluster.cc:1428] Setting key 94ac7013ee242e4c6f98f2b1d06af96b
Aug 06 16:57:44 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035464, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:57:44.237725 16595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:44.222146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:44995 (local address 127.7.153.62:40287)
0806 16:57:44.222343 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:44.222349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:44.223323 (+ 974us) server_negotiation.cc:407] Connection header received
0806 16:57:44.225019 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:44.225023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:44.225074 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:44.225176 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:44.226807 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.227372 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.228821 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.229232 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.229360 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:44.233064 (+ 3704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:44.233068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:44.233071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:44.233110 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:44.234903 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:44.235716 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:44.235720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:44.235724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:44.235829 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:44.236238 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:44.236241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:44.236243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:44.236621 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:44.236767 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:44.237417 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 16:57:44.237586 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 16:57:44.238754 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:44.222551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:44995)
0806 16:57:44.223117 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:44.223184 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:44.224802 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:44.225345 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:44.225352 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:44.225818 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:44.226591 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:44.226617 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.227516 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.227523 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:44.228635 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:44.228655 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.229435 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.229441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:44.229712 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:44.230469 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:44.230497 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:44.232834 (+ 2337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:44.235083 (+ 2249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:44.235091 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:44.235114 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:44.235537 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:44.235952 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:44.235954 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:44.235956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:44.236117 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:44.236795 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:44.236803 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:44.237112 (+ 309us) client_negotiation.cc:769] Sending connection context
0806 16:57:44.237321 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 16:57:44.237717 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":142,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:57:44.240265 16758 heartbeater.cc:347] Connected to a master server at 127.7.153.62:40287
I20260806 16:57:44.240562 16758 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:44.241218 16758 heartbeater.cc:511] Master 127.7.153.62:40287 requested a full tablet report, sending...
I20260806 16:57:44.242957 16554 ts_manager.cc:194] Registered new tserver with Master: bb80f1fe4d2e4150a2644b6b59566282 (127.7.153.1:34493)
I20260806 16:57:44.244203 16554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:44995
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:57:44.258217 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:40287
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:44.380836 16764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:44.381248 16764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:44.381322 16764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:44.385890 16764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:44.385963 16764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:44.386029 16764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:44.391801 16764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:40287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:44.393097 16764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:44.394404 16764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:44.405375 16770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:44.405414 16773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:44.405375 16771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:44.405638 16764 server_base.cc:1034] running on GCE node
I20260806 16:57:44.406111 16764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:44.406838 16764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:44.408037 16764 hybrid_clock.cc:648] HybridClock initialized: now 1786035464407997 us; error 51 us; skew 500 ppm
Aug 06 16:57:44 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035464, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:44.411304 16764 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:57:44.412320 16764 webserver.cc:460] Webserver started at http://127.7.153.2:35237/ using document root <none> and password file <none>
I20260806 16:57:44.413033 16764 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:44.413108 16764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:44.413308 16764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:44.415700 16764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "dd0b1db8fdfb4caeaacbf254420e092a"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "5533cd3cd6314ed1d3d771d0e88fe108"
server_key_iv: "24ad64fcdc3503ffc71be3f827ffce0e"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.416400 16764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "dd0b1db8fdfb4caeaacbf254420e092a"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "5533cd3cd6314ed1d3d771d0e88fe108"
server_key_iv: "24ad64fcdc3503ffc71be3f827ffce0e"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.421371 16764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 16:57:44.425047 16780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.426486 16764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 16:57:44.426664 16764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "dd0b1db8fdfb4caeaacbf254420e092a"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "5533cd3cd6314ed1d3d771d0e88fe108"
server_key_iv: "24ad64fcdc3503ffc71be3f827ffce0e"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.426806 16764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:44.456584 16764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:44.460577 16764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:44.460886 16764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:44.461607 16764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:44.462589 16764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:44.462671 16764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.462751 16764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:44.462809 16764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.472952 16764 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:41009
I20260806 16:57:44.472975 16902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:41009 every 8 connection(s)
I20260806 16:57:44.474071 16764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:44.477178 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 16764
I20260806 16:57:44.477329 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:57:44.477681 7780 external_mini_cluster.cc:1428] Setting key 7f19e716fc1b64fbf9fd5bfac2a5cb22
Aug 06 16:57:44 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035464, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:57:44.491106 16595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:44.476215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:39237 (local address 127.7.153.62:40287)
0806 16:57:44.476406 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:44.476410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:44.477494 (+ 1084us) server_negotiation.cc:407] Connection header received
0806 16:57:44.479049 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:44.479053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:44.479106 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:44.479198 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:44.480553 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.481449 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.483431 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.483693 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.483819 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:44.486955 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:44.486967 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:44.486970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:44.487002 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:44.488644 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:44.489378 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:44.489382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:44.489383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:44.489467 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:44.489862 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:44.489865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:44.489867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:44.490086 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:44.490204 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:44.490789 (+ 585us) server_negotiation.cc:299] Negotiation successful
0806 16:57:44.490932 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 16:57:44.492426 16907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:44.476632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:39237)
0806 16:57:44.477302 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:44.477371 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:44.478824 (+ 1453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:44.479408 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:44.479416 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:44.479816 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:44.480374 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:44.480389 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.481618 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.481624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:44.483278 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:44.483296 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.483875 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.483880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:44.484090 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:44.484926 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:44.484948 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:44.486695 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:44.488840 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:44.488848 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:44.488870 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:44.489247 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:44.489567 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:44.489571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:44.489572 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:44.489744 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:44.490205 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:44.490215 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:44.490517 (+ 302us) client_negotiation.cc:769] Sending connection context
0806 16:57:44.490746 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 16:57:44.491122 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":143,"threads_started":1}
I20260806 16:57:44.493986 16903 heartbeater.cc:347] Connected to a master server at 127.7.153.62:40287
I20260806 16:57:44.494343 16903 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:44.494920 16903 heartbeater.cc:511] Master 127.7.153.62:40287 requested a full tablet report, sending...
I20260806 16:57:44.496235 16554 ts_manager.cc:194] Registered new tserver with Master: dd0b1db8fdfb4caeaacbf254420e092a (127.7.153.2:41009)
I20260806 16:57:44.497205 16554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:39237
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:57:44.511744 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:40287
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:44.633952 16910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:44.634337 16910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:44.634410 16910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:44.639406 16910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:44.639510 16910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:44.639619 16910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:44.645613 16910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:40287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:44.646922 16910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:44.648036 16910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:44.658794 16916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:44.658794 16918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:44.658908 16915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:44.659286 16910 server_base.cc:1034] running on GCE node
I20260806 16:57:44.659770 16910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:44.660519 16910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:44.661707 16910 hybrid_clock.cc:648] HybridClock initialized: now 1786035464661671 us; error 51 us; skew 500 ppm
Aug 06 16:57:44 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035464, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:44.664968 16910 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:57:44.666060 16910 webserver.cc:460] Webserver started at http://127.7.153.3:42715/ using document root <none> and password file <none>
I20260806 16:57:44.666720 16910 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:44.666819 16910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:44.667073 16910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:57:44.669445 16910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "0de4cca259b94c6a88489f8cf82a6e76"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "802e7e056647284b703d21759e0262af"
server_key_iv: "1adfcb164543cff53119205ed4a844e9"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.670140 16910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "0de4cca259b94c6a88489f8cf82a6e76"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "802e7e056647284b703d21759e0262af"
server_key_iv: "1adfcb164543cff53119205ed4a844e9"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.674523 16910 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:57:44.677946 16925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.679456 16910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:44.679637 16910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "0de4cca259b94c6a88489f8cf82a6e76"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "802e7e056647284b703d21759e0262af"
server_key_iv: "1adfcb164543cff53119205ed4a844e9"
server_key_version: "encryptionkey@0"
I20260806 16:57:44.679811 16910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:44.719106 16910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:44.723063 16910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:44.723301 16910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:44.723996 16910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:44.725061 16910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:44.725122 16910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.725165 16910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:44.725211 16910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:44.735301 16910 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:37503
I20260806 16:57:44.735379 17045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:37503 every 8 connection(s)
I20260806 16:57:44.736388 16910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:44.741281 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 16910
I20260806 16:57:44.741487 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:57:44.741793 7780 external_mini_cluster.cc:1428] Setting key aa04542f4c6d02615a170b5fb4284885
Aug 06 16:57:44 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035464, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:57:44.752009 16595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:44.738471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:35947 (local address 127.7.153.62:40287)
0806 16:57:44.738670 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:44.738675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:44.739630 (+ 955us) server_negotiation.cc:407] Connection header received
0806 16:57:44.741251 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:44.741257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:44.741328 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:44.741449 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:44.743247 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.743842 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.745196 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.745435 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.745538 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:44.748242 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:44.748245 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:44.748248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:44.748274 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:44.749752 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:44.750374 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:44.750377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:44.750378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:44.750466 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:44.750881 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:44.750884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:44.750885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:44.751106 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:44.751197 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:44.751747 (+ 550us) server_negotiation.cc:299] Negotiation successful
0806 16:57:44.751873 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 16:57:44.753096 17048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:44.738935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:35947)
0806 16:57:44.739462 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:44.739507 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:44.740810 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:44.741709 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:44.741718 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:44.742237 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:44.743006 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:44.743025 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.744018 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.744022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:44.745072 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:44.745083 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:44.745593 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:44.745595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:44.745751 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:44.746436 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:44.746455 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:44.748050 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:57:44.749917 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:44.749923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:44.749940 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:44.750242 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:44.750558 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:57:44.750560 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:57:44.750562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:57:44.750723 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:57:44.751205 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:57:44.751211 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:57:44.751499 (+ 288us) client_negotiation.cc:769] Sending connection context
0806 16:57:44.751689 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 16:57:44.751993 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":170,"threads_started":1}
I20260806 16:57:44.754386 17046 heartbeater.cc:347] Connected to a master server at 127.7.153.62:40287
I20260806 16:57:44.754683 17046 heartbeater.cc:464] Registering TS with master...
I20260806 16:57:44.755375 17046 heartbeater.cc:511] Master 127.7.153.62:40287 requested a full tablet report, sending...
I20260806 16:57:44.756671 16554 ts_manager.cc:194] Registered new tserver with Master: 0de4cca259b94c6a88489f8cf82a6e76 (127.7.153.3:37503)
I20260806 16:57:44.757397 16554 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:35947
I20260806 16:57:44.768891 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab.
Entry for principal oryx/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab.
WARNING: no policy specified for oryx/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab.
Entry for principal oryx/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab.
WARNING: no policy specified for oryx/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab.
Entry for principal oryx/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab.
I20260806 16:57:44.859683 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 16621
I20260806 16:57:44.870383 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 16764
I20260806 16:57:44.881852 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 16910
I20260806 16:57:44.890305 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 16522
I20260806 16:57:44.900334 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:40287
--webserver_interface=127.7.153.62
--webserver_port=41539
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:40287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:57:45.030857 17055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:45.031237 17055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:45.031329 17055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:45.036291 17055 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:57:45.036458 17055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:45.036507 17055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:45.036556 17055 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:57:45.036602 17055 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:57:45.044037 17055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:40287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:40287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=41539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:45.045589 17055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:45.046802 17055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:45.056583 17063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.056583 17061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.056602 17060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:45.056741 17055 server_base.cc:1034] running on GCE node
I20260806 16:57:45.057803 17055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:45.059194 17055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:45.060391 17055 hybrid_clock.cc:648] HybridClock initialized: now 1786035465060362 us; error 48 us; skew 500 ppm
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035465, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:45.063657 17055 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:57:45.064811 17055 webserver.cc:460] Webserver started at http://127.7.153.62:41539/ using document root <none> and password file <none>
I20260806 16:57:45.065462 17055 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:45.065587 17055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:45.069967 17055 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260806 16:57:45.072355 17070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.073746 17055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:45.073920 17055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "4939bccc1be34ce49565617a9aa21dc1"
format_stamp: "Formatted at 2026-08-06 16:57:43 on dist-test-slave-cbsf"
server_key: "d4d48c7d66099d30deb1a308ffce0082"
server_key_iv: "0c93d95e62fc8ee1e1a0ad71ddfcdde3"
server_key_version: "encryptionkey@0"
I20260806 16:57:45.074569 17055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:45.095378 17055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:45.100138 17055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:45.100494 17055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:45.110075 17055 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:40287
I20260806 16:57:45.110174 17127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:40287 every 8 connection(s)
I20260806 16:57:45.111440 17055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:57:45.117970 17128 sys_catalog.cc:263] Verifying existing consensus state
I20260806 16:57:45.119896 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17055
I20260806 16:57:45.120196 17128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Bootstrap starting.
I20260806 16:57:45.120476 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:34493
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:40287
--webserver_port=44867
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:57:45.139824 17128 log.cc:824] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Log is configured to *not* fsync() on all Append() calls
I20260806 16:57:45.148940 17128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 16:57:45.149451 17128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Bootstrap complete.
I20260806 16:57:45.154325 17128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:45.154995 17128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4939bccc1be34ce49565617a9aa21dc1, State: Initialized, Role: FOLLOWER
I20260806 16:57:45.155604 17128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:45.155779 17128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:57:45.155865 17128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:57:45.155990 17128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 1 FOLLOWER]: Advancing to term 2
I20260806 16:57:45.159313 17128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:45.159942 17128 leader_election.cc:302] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4939bccc1be34ce49565617a9aa21dc1; no voters:
I20260806 16:57:45.160459 17128 leader_election.cc:288] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 16:57:45.160727 17132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 16:57:45.161259 17132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [term 2 LEADER]: Becoming Leader. State: Replica: 4939bccc1be34ce49565617a9aa21dc1, State: Running, Role: LEADER
I20260806 16:57:45.161727 17132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } }
I20260806 16:57:45.162454 17128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:57:45.164125 17134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4939bccc1be34ce49565617a9aa21dc1. Latest consensus state: current_term: 2 leader_uuid: "4939bccc1be34ce49565617a9aa21dc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } } }
I20260806 16:57:45.164340 17134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:45.164129 17133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4939bccc1be34ce49565617a9aa21dc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4939bccc1be34ce49565617a9aa21dc1" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 40287 } } }
I20260806 16:57:45.164680 17133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1 [sys.catalog]: This master's current role is: LEADER
I20260806 16:57:45.165208 17139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:57:45.169189 17139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:57:45.170272 17139 catalog_manager.cc:1259] Loaded cluster ID: d8d8d946ab8f4f06af4ff8cd79793463
I20260806 16:57:45.170352 17139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:57:45.172914 17139 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:57:45.173763 17139 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4939bccc1be34ce49565617a9aa21dc1: Loaded TSK: 0
I20260806 16:57:45.175089 17139 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 16:57:45.266801 17130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:45.267123 17130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:45.267174 17130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:45.271665 17130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:45.271749 17130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:45.271819 17130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:57:45.278729 17130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.1.keytab
--principal=oryx/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:34493
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=44867
--tserver_master_addrs=127.7.153.62:40287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:45.280020 17130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:45.281219 17130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:45.293031 17156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.293258 17159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.293032 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:45.294000 17130 server_base.cc:1034] running on GCE node
I20260806 16:57:45.294519 17130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:45.295322 17130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:45.296530 17130 hybrid_clock.cc:648] HybridClock initialized: now 1786035465296496 us; error 58 us; skew 500 ppm
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035465, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:45.300269 17130 init.cc:377] Logged in from keytab as oryx/127.7.153.1@KRBTEST.COM (short username oryx)
I20260806 16:57:45.301505 17130 webserver.cc:460] Webserver started at http://127.7.153.1:44867/ using document root <none> and password file <none>
I20260806 16:57:45.302152 17130 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:45.302281 17130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:45.306838 17130 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 16:57:45.309325 17167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.310986 17130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:45.311129 17130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "bb80f1fe4d2e4150a2644b6b59566282"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "be865a39c40e046645b2d89bfa40d341"
server_key_iv: "82bbd6d37e3e03b1a5863c55d28f96f9"
server_key_version: "encryptionkey@0"
I20260806 16:57:45.311754 17130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:45.332947 17130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:45.336472 17130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:45.336779 17130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:45.337496 17130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:45.338457 17130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:45.338507 17130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.338549 17130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:45.338593 17130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.349393 17130 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:34493
I20260806 16:57:45.349426 17288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:34493 every 8 connection(s)
I20260806 16:57:45.350693 17130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:57:45.360670 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17130
I20260806 16:57:45.361348 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:41009
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:40287
--webserver_port=35237
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.366215 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.353366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:36163)
0806 16:57:45.353899 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.353959 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.355355 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.356488 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.356496 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.356953 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.357493 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.357508 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.358898 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.358901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.359960 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.359972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.360980 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.360985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.361203 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.361946 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.361974 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.365121 (+ 3147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":160,"threads_started":1}
W20260806 16:57:45.366328 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.353119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:36163 (local address 127.7.153.62:40287)
0806 16:57:45.353610 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.353627 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.354097 (+ 470us) server_negotiation.cc:407] Connection header received
0806 16:57:45.355775 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.355786 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.356083 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.356366 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.357694 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.358738 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.360120 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.360673 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.360995 (+ 322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.365544 (+ 4549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:36163: BlockingRecv error: recv got EOF from 127.7.153.1:36163 (error 108)
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":148,"threads_started":1}
W20260806 16:57:45.366966 17289 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:40287 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.153.62:40287: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.373440 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.367520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:43805)
0806 16:57:45.367681 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.367697 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.367804 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.368087 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.368090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.368274 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.368389 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.368395 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.369237 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.369242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.369808 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.369816 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.370285 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.370288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.370386 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.370992 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.371005 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.373263 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 16:57:45.373541 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.367605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:43805 (local address 127.7.153.62:40287)
0806 16:57:45.367718 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.367724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.367743 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:45.367931 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.367934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.367980 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.368077 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.368512 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.369124 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.369934 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.370164 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.370279 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.373419 (+ 3140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:43805: BlockingRecv error: recv got EOF from 127.7.153.1:43805 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.379921 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.374372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:37313)
0806 16:57:45.374517 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.374533 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.374652 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.374921 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.374924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.375096 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.375174 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.375180 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.375935 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.375938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.376464 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.376472 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.377030 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.377033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.377119 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.377682 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.377694 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.379740 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 16:57:45.379968 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.374461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:37313 (local address 127.7.153.62:40287)
0806 16:57:45.374578 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.374584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.374600 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:45.374768 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.374771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.374822 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.374911 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.375295 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.375814 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.376620 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.376911 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.377024 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.379864 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:37313: BlockingRecv error: recv got EOF from 127.7.153.1:37313 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 16:57:45.380386 17289 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 16:57:45.492396 17293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:45.492798 17293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:45.492899 17293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:45.497614 17293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:45.497748 17293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:45.497849 17293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:57:45.504575 17293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.2.keytab
--principal=oryx/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:41009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=35237
--tserver_master_addrs=127.7.153.62:40287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:45.505978 17293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:45.507149 17293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:45.518589 17299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.518630 17298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.518667 17301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:45.518862 17293 server_base.cc:1034] running on GCE node
I20260806 16:57:45.519466 17293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:45.520293 17293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:45.521562 17293 hybrid_clock.cc:648] HybridClock initialized: now 1786035465521492 us; error 69 us; skew 500 ppm
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035465, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:45.525854 17293 init.cc:377] Logged in from keytab as oryx/127.7.153.2@KRBTEST.COM (short username oryx)
I20260806 16:57:45.527029 17293 webserver.cc:460] Webserver started at http://127.7.153.2:35237/ using document root <none> and password file <none>
I20260806 16:57:45.527696 17293 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:45.527832 17293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:45.532363 17293 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:45.534875 17309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.536260 17293 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:57:45.536448 17293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "dd0b1db8fdfb4caeaacbf254420e092a"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "5533cd3cd6314ed1d3d771d0e88fe108"
server_key_iv: "24ad64fcdc3503ffc71be3f827ffce0e"
server_key_version: "encryptionkey@0"
I20260806 16:57:45.537225 17293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:45.554462 17293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:45.558154 17293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:45.558398 17293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:45.559087 17293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:45.560051 17293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:45.560129 17293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.560201 17293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:45.560256 17293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.570456 17293 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:41009
I20260806 16:57:45.570514 17432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:41009 every 8 connection(s)
I20260806 16:57:45.571661 17293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:57:45.573012 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17293
I20260806 16:57:45.573586 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:37503
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:40287
--webserver_port=42715
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
W20260806 16:57:45.586910 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.574070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:44787 (local address 127.7.153.62:40287)
0806 16:57:45.574244 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.574248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.575289 (+ 1041us) server_negotiation.cc:407] Connection header received
0806 16:57:45.577417 (+ 2128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.577422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.577498 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.577618 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.579061 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.579701 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.581835 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.582063 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.582157 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.586772 (+ 4615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:44787: BlockingRecv error: recv got EOF from 127.7.153.2:44787 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 16:57:45.587647 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.574495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:44787)
0806 16:57:45.575109 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.575155 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.577112 (+ 1957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.577821 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.577830 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.578270 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.578890 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.578905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.579875 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.579883 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.581656 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.581677 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.582266 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.582273 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.582545 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.583358 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.583388 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.586609 (+ 3221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":181,"threads_started":1}
W20260806 16:57:45.588212 17433 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:40287 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.153.62:40287: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.594314 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.588736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:53589)
0806 16:57:45.588894 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.588916 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.589026 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.589336 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.589339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.589532 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.589635 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.589641 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.590430 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.590435 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.591035 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.591044 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.591506 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.591510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.591606 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.592186 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.592197 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.594134 (+ 1937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 16:57:45.594404 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.588945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:53589 (local address 127.7.153.62:40287)
0806 16:57:45.589112 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.589117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.589137 (+ 20us) server_negotiation.cc:407] Connection header received
0806 16:57:45.589184 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.589186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.589224 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.589317 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.589761 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.590311 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.591171 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.591389 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.591503 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.594279 (+ 2776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:53589: BlockingRecv error: recv got EOF from 127.7.153.2:53589 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.601509 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.595196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:36781)
0806 16:57:45.595371 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.595385 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.595461 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.595708 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.595711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.595893 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.596007 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.596018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.596827 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.596831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.597724 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.597738 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.598541 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.598545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.598644 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.599152 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.599169 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.601363 (+ 2194us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109}
W20260806 16:57:45.601862 17433 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 16:57:45.602079 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.595284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:36781 (local address 127.7.153.62:40287)
0806 16:57:45.595402 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.595406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.595420 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:57:45.595552 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.595554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.595593 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.595675 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.596135 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.596631 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.597983 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.598399 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.598515 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.601540 (+ 3025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:36781: BlockingRecv error: recv got EOF from 127.7.153.2:36781 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260806 16:57:45.706538 17436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:57:45.706885 17436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:57:45.706945 17436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:57:45.711397 17436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:57:45.711506 17436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:57:45.711573 17436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:57:45.717671 17436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/krb5kdc/oryx_127.7.153.3.keytab
--principal=oryx/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:37503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=42715
--tserver_master_addrs=127.7.153.62:40287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:57:45.718974 17436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:57:45.720136 17436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:57:45.731621 17442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.731648 17441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:57:45.731640 17444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:57:45.731720 17436 server_base.cc:1034] running on GCE node
I20260806 16:57:45.732398 17436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:57:45.733240 17436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:57:45.734465 17436 hybrid_clock.cc:648] HybridClock initialized: now 1786035465734446 us; error 33 us; skew 500 ppm
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035465, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:57:45.738269 17436 init.cc:377] Logged in from keytab as oryx/127.7.153.3@KRBTEST.COM (short username oryx)
I20260806 16:57:45.739370 17436 webserver.cc:460] Webserver started at http://127.7.153.3:42715/ using document root <none> and password file <none>
I20260806 16:57:45.739971 17436 fs_manager.cc:359] Metadata directory not provided
I20260806 16:57:45.740058 17436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:57:45.745151 17436 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 16:57:45.747628 17451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.749238 17436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:57:45.749409 17436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "0de4cca259b94c6a88489f8cf82a6e76"
format_stamp: "Formatted at 2026-08-06 16:57:44 on dist-test-slave-cbsf"
server_key: "802e7e056647284b703d21759e0262af"
server_key_iv: "1adfcb164543cff53119205ed4a844e9"
server_key_version: "encryptionkey@0"
I20260806 16:57:45.750020 17436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:57:45.776151 17436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:57:45.780355 17436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:57:45.780602 17436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:57:45.781365 17436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:57:45.782368 17436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:57:45.782418 17436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.782502 17436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:57:45.782536 17436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:57:45.792886 17436 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:37503
I20260806 16:57:45.792924 17569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:37503 every 8 connection(s)
I20260806 16:57:45.794067 17436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:57:45.794350 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17436
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.807485 17291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.795350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.7.153.62:40287)
0806 16:57:45.795577 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.795584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.795607 (+ 23us) server_negotiation.cc:407] Connection header received
0806 16:57:45.795836 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.795839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.795897 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.796010 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.797547 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.798197 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.799195 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.799454 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.799576 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.801803 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:57:45.801809 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:57:45.801826 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:57:45.801867 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:57:45.804518 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:45.805289 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:45.805295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:45.805300 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:45.805439 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:57:45.805891 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:57:45.805898 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:57:45.805902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:57:45.806369 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:57:45.806606 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 16:57:45.806960 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 16:57:45.807290 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
W20260806 16:57:45.807602 17573 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.796642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:54479 (local address 127.7.153.62:40287)
0806 16:57:45.797074 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.797079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.797568 (+ 489us) server_negotiation.cc:407] Connection header received
0806 16:57:45.798952 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.798956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.799015 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.799122 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.800624 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.801301 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.802748 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.803045 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.803185 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.807460 (+ 4275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:54479: BlockingRecv error: recv got EOF from 127.7.153.3:54479 (error 108)
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":127,"threads_started":1}
I20260806 16:57:45.808470 17574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.796767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:54479)
0806 16:57:45.797321 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.797378 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.798686 (+ 1308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.799313 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.799322 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.799738 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.800448 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.800468 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.801444 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.801448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.802603 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.802622 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.803304 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.803310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.803575 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.804180 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.804206 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.807327 (+ 3121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":152,"threads_started":1}
W20260806 16:57:45.809037 17570 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:40287 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.153.62:40287: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.816151 17574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.809730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:54241)
0806 16:57:45.809883 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.809901 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.809994 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.810278 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.810282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.810490 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.810601 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.810609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.811423 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.811427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.812016 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.812026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.812524 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.812529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.812633 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.813319 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.813333 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.816020 (+ 2687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 16:57:45.816417 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.809859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:54241 (local address 127.7.153.62:40287)
0806 16:57:45.810043 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.810047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.810062 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:45.810100 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.810102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.810144 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.810256 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.810742 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.811286 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.812159 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.812393 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.812521 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.816295 (+ 3774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:54241: BlockingRecv error: recv got EOF from 127.7.153.3:54241 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:45 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:45.823549 17574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:45.816888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:57393)
0806 16:57:45.817036 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:45.817058 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:45.817136 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:45.817423 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:45.817425 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:45.817569 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:45.817664 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.817669 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.818653 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.818680 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.819440 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:45.819458 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.820060 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.820065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:45.820180 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.820901 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:45.820914 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:45.823436 (+ 2522us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 16:57:45.823707 17291 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:45.817056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:57393 (local address 127.7.153.62:40287)
0806 16:57:45.817227 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:45.817230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:45.817242 (+ 12us) server_negotiation.cc:407] Connection header received
0806 16:57:45.817281 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:45.817283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:45.817321 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:45.817388 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:45.817790 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.818432 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.819638 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:45.819893 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:45.819999 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:45.823579 (+ 3580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:57393: BlockingRecv error: recv got EOF from 127.7.153.3:57393 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260806 16:57:45.823838 17570 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 16:57:46 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:46 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:46.387488 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:46.381231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:44713)
0806 16:57:46.381533 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:46.381546 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:46.381652 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:46.381976 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:46.381979 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:46.382197 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:46.382302 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:46.382308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.383161 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.383164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:46.383785 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:46.383794 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.384273 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.384275 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:46.384338 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:46.385101 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:46.385114 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:46.387309 (+ 2195us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":100,"threads_started":1}
W20260806 16:57:46.387671 17576 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:46.381308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:44713 (local address 127.7.153.62:40287)
0806 16:57:46.381602 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:46.381606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:46.381622 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:46.381759 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:46.381761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:46.381806 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:46.381901 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:46.382457 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.383041 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.383918 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.384157 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.384260 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:46.387505 (+ 3245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:44713: BlockingRecv error: recv got EOF from 127.7.153.1:44713 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":123,"threads_started":1}
Aug 06 16:57:46 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:46 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:46.608771 17577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:46.602716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:44699)
0806 16:57:46.603013 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:46.603036 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:46.603147 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:46.603404 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:46.603406 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:46.603598 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:46.603698 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:46.603704 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.604549 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.604551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:46.605171 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:46.605180 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.605781 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.605784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:46.605882 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:46.606542 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:46.606555 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:46.608558 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":107,"threads_started":1}
W20260806 16:57:46.608865 17576 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:46.602799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:44699 (local address 127.7.153.62:40287)
0806 16:57:46.602956 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:46.602960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:46.603112 (+ 152us) server_negotiation.cc:407] Connection header received
0806 16:57:46.603234 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:46.603236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:46.603283 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:46.603366 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:46.603855 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.604414 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.605338 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.605642 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.605771 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:46.608736 (+ 2965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:44699: BlockingRecv error: recv got EOF from 127.7.153.2:44699 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 16:57:46 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:46 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:46.830530 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:46.824637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:50343)
0806 16:57:46.824978 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:46.824994 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:46.825125 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:46.825420 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:46.825423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:46.825644 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:46.825745 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:46.825750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.826497 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.826500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:46.827105 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:46.827114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.827543 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.827545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:46.827609 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:46.828144 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:46.828156 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:46.830378 (+ 2222us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":140,"threads_started":1}
W20260806 16:57:46.830899 17576 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:46.824637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:50343 (local address 127.7.153.62:40287)
0806 16:57:46.824837 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:46.824843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:46.825093 (+ 250us) server_negotiation.cc:407] Connection header received
0806 16:57:46.825222 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:46.825227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:46.825283 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:46.825373 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:46.825855 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.826378 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.827226 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:46.827438 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:46.827517 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:46.830574 (+ 3057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:50343: BlockingRecv error: recv got EOF from 127.7.153.3:50343 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 16:57:47 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:47 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:47.394372 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:47.388471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:49993)
0806 16:57:47.388809 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:47.388824 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:47.388935 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:47.389176 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:47.389178 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:47.389360 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:47.389462 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:47.389467 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.390222 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.390224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:47.390808 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:47.390816 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.391339 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.391342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:47.391412 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:47.391958 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:47.391970 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:47.394191 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":93,"threads_started":1}
W20260806 16:57:47.394557 17580 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:47.388492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:49993 (local address 127.7.153.62:40287)
0806 16:57:47.388817 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:47.388821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:47.388896 (+ 75us) server_negotiation.cc:407] Connection header received
0806 16:57:47.389024 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:47.389026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:47.389073 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:47.389164 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:47.389563 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.390101 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.390960 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.391213 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.391308 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:47.394401 (+ 3093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:49993: BlockingRecv error: recv got EOF from 127.7.153.1:49993 (error 108)
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":91,"threads_started":1}
Aug 06 16:57:47 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:47 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:47.615340 17581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:47.609769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:50673)
0806 16:57:47.610041 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:47.610055 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:47.610212 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:47.610517 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:47.610519 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:47.610743 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:47.610841 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:47.610846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.611655 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.611657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:47.612198 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:47.612205 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.612642 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.612645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:47.612776 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:47.613332 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:47.613343 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:47.615194 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":106,"threads_started":1}
W20260806 16:57:47.615510 17580 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:47.609842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:50673 (local address 127.7.153.62:40287)
0806 16:57:47.610008 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:47.610013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:47.610202 (+ 189us) server_negotiation.cc:407] Connection header received
0806 16:57:47.610347 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:47.610350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:47.610399 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:47.610486 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:47.610989 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.611555 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.612304 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.612537 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.612617 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:47.615361 (+ 2744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:50673: BlockingRecv error: recv got EOF from 127.7.153.2:50673 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 16:57:47 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:47 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:47.837359 17582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:47.831614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:45957)
0806 16:57:47.831955 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:47.831969 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:47.832068 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:47.832357 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:47.832360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:47.832549 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:47.832649 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:47.832655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.833515 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.833517 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:47.834093 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:47.834102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.834629 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.834632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:47.834709 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:47.835289 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:47.835301 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:47.837207 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":120,"threads_started":1}
W20260806 16:57:47.837617 17580 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:47.831825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:45957 (local address 127.7.153.62:40287)
0806 16:57:47.832016 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:47.832020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:47.832039 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:47.832171 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:47.832173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:47.832230 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:47.832323 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:47.832832 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.833383 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.834231 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:47.834501 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:47.834611 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:47.837445 (+ 2834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:45957: BlockingRecv error: recv got EOF from 127.7.153.3:45957 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 06 16:57:48 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:48 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:48.401665 17583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:48.395539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:44155)
0806 16:57:48.395899 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:48.395913 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:48.396021 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:48.396287 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:48.396289 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:48.396479 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:48.396604 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:48.396609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.397472 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.397475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:48.398098 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:48.398113 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.398597 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.398602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:48.398688 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:48.399372 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:48.399384 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:48.401476 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":134,"threads_started":1}
W20260806 16:57:48.401957 17585 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:48.395731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:44155 (local address 127.7.153.62:40287)
0806 16:57:48.395976 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:48.395980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:48.395995 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:48.396122 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:48.396125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:48.396170 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:48.396250 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:48.396759 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.397339 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.398230 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.398467 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.398557 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:48.401682 (+ 3125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:44155: BlockingRecv error: recv got EOF from 127.7.153.1:44155 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":70,"threads_started":1}
Aug 06 16:57:48 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:48 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
W20260806 16:57:48.623003 17585 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:48.616501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:57261 (local address 127.7.153.62:40287)
0806 16:57:48.616662 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:48.616666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:48.616900 (+ 234us) server_negotiation.cc:407] Connection header received
0806 16:57:48.617022 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:48.617027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:48.617088 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:48.617176 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:48.617802 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.618611 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.619419 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.619667 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.619752 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:48.622884 (+ 3132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:57261: BlockingRecv error: recv got EOF from 127.7.153.2:57261 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 16:57:48.623031 17587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:48.616334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:57261)
0806 16:57:48.616783 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:48.616797 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:48.616915 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:48.617239 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:48.617243 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:48.617490 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:48.617657 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:48.617669 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.618717 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.618720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:48.619294 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:48.619302 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.619781 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.619784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:48.619850 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:48.620376 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:48.620388 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:48.622684 (+ 2296us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":98,"threads_started":1}
Aug 06 16:57:48 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:48 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:48.850426 17588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:48.838517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:48447)
0806 16:57:48.838929 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:48.838943 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:48.839099 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:48.839586 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:48.839589 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:48.839848 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:48.839997 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:48.840005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.841120 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.841123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:48.841734 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:48.841743 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.842301 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.842307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:48.842396 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:48.847892 (+ 5496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:48.847919 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:48.850213 (+ 2294us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":154,"threads_started":1}
W20260806 16:57:48.850523 17585 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:48.838702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:48447 (local address 127.7.153.62:40287)
0806 16:57:48.838858 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:48.838863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:48.839035 (+ 172us) server_negotiation.cc:407] Connection header received
0806 16:57:48.839375 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:48.839378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:48.839441 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:48.839536 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:48.840151 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.841002 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.841893 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:48.842132 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:48.842280 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:48.850386 (+ 8106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:48447: BlockingRecv error: recv got EOF from 127.7.153.3:48447 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 16:57:49 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:49 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:49.409471 17589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:49.402560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:38221)
0806 16:57:49.402897 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:49.402913 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:49.403012 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:49.403560 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:49.403563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:49.403783 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:49.403923 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:49.403930 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.405153 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.405157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:49.405818 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:49.405831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.406480 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.406484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:49.406563 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:49.407232 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:49.407246 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:49.409334 (+ 2088us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":140,"threads_started":1}
W20260806 16:57:49.409766 17590 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:49.402711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38221 (local address 127.7.153.62:40287)
0806 16:57:49.402966 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:49.402970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:49.402984 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:57:49.403259 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:49.403263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:49.403350 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:49.403481 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:49.404094 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.404844 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.406008 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.406299 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.406450 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:49.409588 (+ 3138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:38221: BlockingRecv error: recv got EOF from 127.7.153.1:38221 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":103,"threads_started":1}
Aug 06 16:57:49 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:49 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:49.630558 17591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:49.624509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:45471)
0806 16:57:49.624867 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:49.624882 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:49.624991 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:49.625294 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:49.625296 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:49.625486 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:49.625582 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:49.625587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.626392 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.626397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:49.626951 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:49.626959 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.627426 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.627429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:49.627518 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:49.628098 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:49.628112 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:49.630386 (+ 2274us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":119,"threads_started":1}
W20260806 16:57:49.630700 17590 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:49.624598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:45471 (local address 127.7.153.62:40287)
0806 16:57:49.624938 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:49.624942 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:49.624963 (+ 21us) server_negotiation.cc:407] Connection header received
0806 16:57:49.625093 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:49.625095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:49.625149 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:49.625266 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:49.625717 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.626273 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.627074 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.627305 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.627420 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:49.630574 (+ 3154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:45471: BlockingRecv error: recv got EOF from 127.7.153.2:45471 (error 108)
Metrics: {"server-negotiator.queue_time_us":198}
Aug 06 16:57:49 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:49 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:49.858263 17592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:49.851423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:43127)
0806 16:57:49.851760 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:49.851779 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:49.851911 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:49.852211 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:49.852214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:49.852440 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:49.852538 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:49.852544 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.853377 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.853382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:49.853959 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:49.853968 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.854449 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.854453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:49.854532 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:49.855774 (+ 1242us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:49.855788 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:49.858030 (+ 2242us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":87,"threads_started":1}
W20260806 16:57:49.858448 17590 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:49.851488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:43127 (local address 127.7.153.62:40287)
0806 16:57:49.851635 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:49.851640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:49.851862 (+ 222us) server_negotiation.cc:407] Connection header received
0806 16:57:49.852028 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:49.852032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:49.852090 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:49.852190 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:49.852666 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.853255 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.854086 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:49.854323 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:49.854439 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:49.858301 (+ 3862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:43127: BlockingRecv error: recv got EOF from 127.7.153.3:43127 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 16:57:50 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:50 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:50.417986 17593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:50.410707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:37891)
0806 16:57:50.411035 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:50.411050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:50.411146 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:50.411439 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:50.411441 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:50.411661 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:50.411768 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:50.411774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.412869 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.412873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:50.413865 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:50.413882 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.414421 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.414424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:50.414496 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:50.415123 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:50.415141 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:50.417671 (+ 2530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":124,"threads_started":1}
W20260806 16:57:50.418246 17594 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:50.410851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:37891 (local address 127.7.153.62:40287)
0806 16:57:50.411127 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:50.411138 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:50.411155 (+ 17us) server_negotiation.cc:407] Connection header received
0806 16:57:50.411237 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:50.411240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:50.411283 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:50.411378 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:50.411883 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.412612 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.414010 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.414301 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.414390 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:50.418084 (+ 3694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:37891: BlockingRecv error: recv got EOF from 127.7.153.1:37891 (error 108)
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":126,"threads_started":1}
Aug 06 16:57:50 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:50 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:50.637495 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:50.631541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:37219)
0806 16:57:50.631864 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:50.631879 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:50.631968 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:50.632236 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:50.632239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:50.632429 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:50.632539 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:50.632545 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.633323 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.633326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:50.633926 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:50.633935 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.634404 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.634407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:50.634488 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:50.635098 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:50.635112 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:50.637306 (+ 2194us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":124,"threads_started":1}
W20260806 16:57:50.637593 17594 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:50.631758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:37219 (local address 127.7.153.62:40287)
0806 16:57:50.631904 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:50.631908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:50.631926 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:57:50.632064 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:50.632073 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:50.632119 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:50.632195 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:50.632657 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.633212 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.634046 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.634272 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.634355 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:50.637475 (+ 3120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:37219: BlockingRecv error: recv got EOF from 127.7.153.2:37219 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 16:57:50 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:50 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:50.865715 17596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:50.859349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:58547)
0806 16:57:50.859660 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:50.859674 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:50.859773 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:50.860020 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:50.860022 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:50.860248 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:50.860342 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:50.860347 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.861199 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.861202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:50.861805 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:50.861814 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.862264 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.862268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:50.862348 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:50.863100 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:50.863115 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:50.865526 (+ 2411us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":134,"threads_started":1}
W20260806 16:57:50.865844 17594 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:50.859397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:58547 (local address 127.7.153.62:40287)
0806 16:57:50.859549 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:50.859554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:50.859774 (+ 220us) server_negotiation.cc:407] Connection header received
0806 16:57:50.859863 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:50.859865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:50.859918 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:50.859988 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:50.860474 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.861072 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.861909 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:50.862132 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:50.862211 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:50.865713 (+ 3502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:58547: BlockingRecv error: recv got EOF from 127.7.153.3:58547 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 16:57:51 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:51 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:51.426185 17597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:51.419292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:38017)
0806 16:57:51.419741 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:51.419759 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:51.419893 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:51.420221 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:51.420224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:51.420485 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:51.420624 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:51.420637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.421586 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.421589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:51.422166 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:51.422174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.422775 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.422779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:51.422879 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:51.423509 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:51.423522 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:51.426050 (+ 2528us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":117,"threads_started":1}
W20260806 16:57:51.426633 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:51.419366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38017 (local address 127.7.153.62:40287)
0806 16:57:51.419679 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:51.419684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:51.419863 (+ 179us) server_negotiation.cc:407] Connection header received
0806 16:57:51.419977 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:51.419980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:51.420050 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:51.420138 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:51.420864 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.421462 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.422320 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.422590 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.422692 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:51.426276 (+ 3584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:38017: BlockingRecv error: recv got EOF from 127.7.153.1:38017 (error 108)
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":126,"threads_started":1}
Aug 06 16:57:51 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:51 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:51.644941 17599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:51.638542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:42603)
0806 16:57:51.638883 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:51.638897 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:51.639045 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:51.639375 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:51.639378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:51.639655 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:51.639785 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:51.639795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.640621 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.640625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:51.641396 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:51.641407 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.641996 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.642002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:51.642128 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:51.642713 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:51.642726 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:51.644814 (+ 2088us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":96,"threads_started":1}
W20260806 16:57:51.645147 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:51.638598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:42603 (local address 127.7.153.62:40287)
0806 16:57:51.638939 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:51.638944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:51.638984 (+ 40us) server_negotiation.cc:407] Connection header received
0806 16:57:51.639171 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:51.639174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:51.639232 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:51.639327 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:51.639924 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.640490 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.641615 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.641849 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.641937 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:51.644992 (+ 3055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:42603: BlockingRecv error: recv got EOF from 127.7.153.2:42603 (error 108)
Metrics: {"server-negotiator.queue_time_us":234}
Aug 06 16:57:51 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:51 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:51.872880 17600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:51.866803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:46579)
0806 16:57:51.867093 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:51.867108 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:51.867218 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:51.867475 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:51.867477 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:51.867696 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:51.867795 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:51.867800 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.868594 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.868597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:51.869335 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:51.869345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.869822 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.869824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:51.869891 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:51.870433 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:51.870447 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:51.872677 (+ 2230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":75,"threads_started":1}
W20260806 16:57:51.872999 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:51.866885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:46579 (local address 127.7.153.62:40287)
0806 16:57:51.867082 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:51.867086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:51.867187 (+ 101us) server_negotiation.cc:407] Connection header received
0806 16:57:51.867307 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:51.867309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:51.867358 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:51.867444 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:51.867907 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.868461 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.869465 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:51.869708 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:51.869795 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:51.872888 (+ 3093us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:46579: BlockingRecv error: recv got EOF from 127.7.153.3:46579 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 06 16:57:52 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:52 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:52.432858 17601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:52.427230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:48905)
0806 16:57:52.427570 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:52.427588 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:52.427697 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:52.427969 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:52.427971 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:52.428167 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:52.428269 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:52.428274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.429050 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.429053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:52.429618 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:52.429625 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.430054 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.430057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:52.430121 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:52.430732 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:52.430745 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:52.432645 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":90,"threads_started":1}
W20260806 16:57:52.433017 17602 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:52.427296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:48905 (local address 127.7.153.62:40287)
0806 16:57:52.427658 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:52.427663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:52.427679 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:52.427799 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:52.427801 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:52.427847 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:52.427929 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:52.428375 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.428949 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.429727 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.429948 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.430025 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:52.432874 (+ 2849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:48905: BlockingRecv error: recv got EOF from 127.7.153.1:48905 (error 108)
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":83,"threads_started":1}
Aug 06 16:57:52 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:52 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:52.652125 17603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:52.645969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:56559)
0806 16:57:52.646417 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:52.646433 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:52.646586 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:52.646897 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:52.646900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:52.647133 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:52.647223 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:52.647229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.648019 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.648024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:52.648600 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:52.648608 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.649118 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.649122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:52.649202 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:52.649773 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:52.649785 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:52.651950 (+ 2165us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":121,"threads_started":1}
W20260806 16:57:52.652247 17602 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:52.646159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:56559 (local address 127.7.153.62:40287)
0806 16:57:52.646380 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:52.646385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:52.646528 (+ 143us) server_negotiation.cc:407] Connection header received
0806 16:57:52.646720 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:52.646724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:52.646777 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:52.646873 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:52.647347 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.647903 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.648758 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.648995 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.649111 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:52.652136 (+ 3025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:56559: BlockingRecv error: recv got EOF from 127.7.153.2:56559 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 06 16:57:52 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:52 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:52.880945 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:52.873884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:32843)
0806 16:57:52.874421 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:52.874446 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:52.874609 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:52.874910 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:52.874913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:52.875170 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:52.875274 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:52.875280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.876151 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.876154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:52.876947 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:52.876959 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.877777 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.877782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:52.877880 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:52.878553 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:52.878566 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:52.880806 (+ 2240us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":105,"threads_started":1}
W20260806 16:57:52.881117 17602 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:52.874096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:32843 (local address 127.7.153.62:40287)
0806 16:57:52.874398 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:52.874403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:52.874538 (+ 135us) server_negotiation.cc:407] Connection header received
0806 16:57:52.874737 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:52.874739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:52.874788 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:52.874884 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:52.875406 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.876018 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.877167 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:52.877595 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:52.877723 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:52.880983 (+ 3260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:32843: BlockingRecv error: recv got EOF from 127.7.153.3:32843 (error 108)
Metrics: {"server-negotiator.queue_time_us":182}
Aug 06 16:57:53 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:53 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:53.439764 17605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:53.433950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:56847)
0806 16:57:53.434267 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:53.434281 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:53.434377 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:53.434650 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:53.434652 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:53.434841 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:53.434957 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:53.434963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.435775 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.435778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:53.436338 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:53.436347 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.436828 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.436831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:53.436897 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:53.437461 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:53.437474 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:53.439565 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":121,"threads_started":1}
W20260806 16:57:53.439834 17606 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:53.434138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:56847 (local address 127.7.153.62:40287)
0806 16:57:53.434416 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:53.434420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:53.434433 (+ 13us) server_negotiation.cc:407] Connection header received
0806 16:57:53.434476 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:53.434478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:53.434522 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:53.434610 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:53.435106 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.435671 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.436441 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.436669 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.436802 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:53.439709 (+ 2907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:56847: BlockingRecv error: recv got EOF from 127.7.153.1:56847 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":126,"threads_started":1}
Aug 06 16:57:53 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:53 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:53.659590 17607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:53.653266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:46753)
0806 16:57:53.653561 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:53.653582 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:53.653693 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:53.653955 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:53.653957 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:53.654162 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:53.654260 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:53.654265 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.655353 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.655356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:53.656104 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:53.656121 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.656598 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.656602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:53.656682 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:53.657370 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:53.657384 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:53.659468 (+ 2084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
W20260806 16:57:53.659833 17606 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:53.653348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:46753 (local address 127.7.153.62:40287)
0806 16:57:53.653557 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:53.653563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:53.653663 (+ 100us) server_negotiation.cc:407] Connection header received
0806 16:57:53.653783 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:53.653785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:53.653833 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:53.653918 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:53.654413 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.655232 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.656244 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.656476 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.656595 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:53.659582 (+ 2987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:46753: BlockingRecv error: recv got EOF from 127.7.153.2:46753 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 16:57:53 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:53 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:53.894011 17609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:53.881988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:40423)
0806 16:57:53.882328 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:53.882341 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:53.882487 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:53.882806 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:53.882809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:53.883031 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:53.883136 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:53.883142 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.883912 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.883917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:53.884489 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:53.884497 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.885030 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.885033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:53.885127 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:53.891560 (+ 6433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:53.891578 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:53.893818 (+ 2240us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":115,"threads_started":1}
W20260806 16:57:53.894137 17606 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:53.882072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:40423 (local address 127.7.153.62:40287)
0806 16:57:53.882246 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:53.882250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:53.882424 (+ 174us) server_negotiation.cc:407] Connection header received
0806 16:57:53.882627 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:53.882630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:53.882681 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:53.882778 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:53.883262 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.883800 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.884622 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:53.884910 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:53.885023 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:53.894007 (+ 8984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:40423: BlockingRecv error: recv got EOF from 127.7.153.3:40423 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 06 16:57:54 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:54 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:54.447151 17610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:54.440801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:47641)
0806 16:57:54.441230 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:54.441250 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:54.441413 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:54.441822 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:54.441826 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:54.442072 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:54.442275 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:54.442284 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.443134 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.443139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:54.443736 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:54.443746 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.444262 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.444266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:54.444358 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:54.444952 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:54.444965 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:54.446989 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":84,"threads_started":1}
W20260806 16:57:54.447357 17612 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:54.441188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:47641 (local address 127.7.153.62:40287)
0806 16:57:54.441490 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:54.441493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:54.441512 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:54.441558 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:54.441560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:54.441611 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:54.441709 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:54.442433 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.443001 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.443880 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.444120 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.444238 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:54.447221 (+ 2983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:47641: BlockingRecv error: recv got EOF from 127.7.153.1:47641 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":111,"threads_started":1}
Aug 06 16:57:54 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:54 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:54.666718 17613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:54.660450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:55853)
0806 16:57:54.660796 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:54.660810 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:54.660924 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:54.661165 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:54.661167 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:54.661354 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:54.661474 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:54.661479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.662275 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.662278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:54.662975 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:54.662985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.663486 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.663490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:54.663619 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:54.664171 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:54.664183 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:54.666564 (+ 2381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":98,"threads_started":1}
W20260806 16:57:54.666898 17612 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:54.660570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:55853 (local address 127.7.153.62:40287)
0806 16:57:54.660800 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:54.660804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:54.660881 (+ 77us) server_negotiation.cc:407] Connection header received
0806 16:57:54.661011 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:54.661013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:54.661058 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:54.661129 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:54.661607 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.662158 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.663097 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.663340 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.663431 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:54.666759 (+ 3328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:55853: BlockingRecv error: recv got EOF from 127.7.153.2:55853 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 06 16:57:54 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:54 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:54.901878 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:54.895152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:53747)
0806 16:57:54.895479 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:54.895495 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:54.895609 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:54.896159 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:54.896162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:54.896359 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:54.896474 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:54.896480 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.897439 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.897442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:54.898138 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:54.898148 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.898912 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.898915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:54.898981 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:54.899650 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:54.899662 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:54.901752 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":88,"threads_started":1}
W20260806 16:57:54.902092 17612 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:54.895324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:53747 (local address 127.7.153.62:40287)
0806 16:57:54.895508 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:54.895511 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:54.895588 (+ 77us) server_negotiation.cc:407] Connection header received
0806 16:57:54.895866 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:54.895871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:54.895960 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:54.896092 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:54.896658 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.897319 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.898368 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:54.898782 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:54.898906 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:54.901958 (+ 3052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:53747: BlockingRecv error: recv got EOF from 127.7.153.3:53747 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 16:57:55 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:55 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:55.455083 17615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:55.448243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:39703)
0806 16:57:55.448798 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:55.448815 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:55.448934 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:55.449244 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:55.449247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:55.449453 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:55.449556 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:55.449562 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.450389 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.450392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:55.450967 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:55.450975 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.451474 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.451477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:55.451550 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:55.452128 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:55.452150 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:55.454846 (+ 2696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":129,"threads_started":1}
W20260806 16:57:55.455639 17616 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:55.448353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:39703 (local address 127.7.153.62:40287)
0806 16:57:55.448671 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:55.448675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:55.448951 (+ 276us) server_negotiation.cc:407] Connection header received
0806 16:57:55.449010 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:55.449012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:55.449064 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:55.449157 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:55.449707 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.450266 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.451091 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.451332 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.451431 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:55.455437 (+ 4006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:39703: BlockingRecv error: recv got EOF from 127.7.153.1:39703 (error 108)
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":79,"threads_started":1}
Aug 06 16:57:55 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:55 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:55.673641 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:55.667735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:35743)
0806 16:57:55.668089 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:55.668113 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:55.668258 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:55.668544 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:55.668547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:55.668777 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:55.668876 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:55.668882 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.669654 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.669657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:55.670234 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:55.670242 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.670785 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.670788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:55.670866 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:55.671429 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:55.671441 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:55.673508 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":120,"threads_started":1}
W20260806 16:57:55.673895 17616 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:55.667960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:35743 (local address 127.7.153.62:40287)
0806 16:57:55.668111 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:55.668118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:55.668237 (+ 119us) server_negotiation.cc:407] Connection header received
0806 16:57:55.668351 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:55.668353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:55.668396 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:55.668487 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:55.668991 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.669545 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.670339 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.670663 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.670767 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:55.673727 (+ 2960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:35743: BlockingRecv error: recv got EOF from 127.7.153.2:35743 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 06 16:57:55 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:55 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:55.908943 17618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:55.903019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:46355)
0806 16:57:55.903391 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:55.903410 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:55.903528 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:55.903796 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:55.903798 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:55.904008 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:55.904107 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:55.904113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.905030 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.905034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:55.905682 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:55.905691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.906141 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.906144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:55.906229 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:55.906820 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:55.906832 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:55.908808 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":127,"threads_started":1}
W20260806 16:57:55.909111 17616 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:55.903273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:46355 (local address 127.7.153.62:40287)
0806 16:57:55.903418 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:55.903422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:55.903476 (+ 54us) server_negotiation.cc:407] Connection header received
0806 16:57:55.903627 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:55.903630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:55.903678 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:55.903755 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:55.904244 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.904914 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.905799 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:55.906026 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:55.906137 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:55.908944 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:46355: BlockingRecv error: recv got EOF from 127.7.153.3:46355 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 06 16:57:56 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:56 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
W20260806 16:57:56.462946 17620 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:56.456517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38329 (local address 127.7.153.62:40287)
0806 16:57:56.456803 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:56.456807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:56.456823 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:57:56.456980 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:56.456982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:56.457027 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:56.457109 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:56.457589 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.458168 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.459075 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.459322 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.459432 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:56.462791 (+ 3359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:38329: BlockingRecv error: recv got EOF from 127.7.153.1:38329 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":80,"threads_started":1}
I20260806 16:57:56.462996 17619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:56.456291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:38329)
0806 16:57:56.456660 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:56.456674 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:56.456864 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:56.457163 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:56.457166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:56.457366 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:56.457468 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:56.457479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.458311 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.458315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:56.458898 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:56.458907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.459465 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.459468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:56.459536 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:56.460100 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:56.460113 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:56.462608 (+ 2495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":100,"threads_started":1}
Aug 06 16:57:56 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:56 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:56.682058 17621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:56.674583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:58719)
0806 16:57:56.674887 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:56.674901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:56.675002 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:56.675276 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:56.675279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:56.675474 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:56.675595 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:56.675601 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.676868 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.676870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:56.677475 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:56.677484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.678091 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.678096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:56.678212 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:56.678990 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:56.679005 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:56.681811 (+ 2806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":90,"threads_started":1}
W20260806 16:57:56.682156 17620 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:56.674740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:58719 (local address 127.7.153.62:40287)
0806 16:57:56.674943 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:56.674947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:56.674966 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:57:56.675079 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:56.675081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:56.675129 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:56.675199 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:56.675851 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.676670 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.677604 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.677879 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.678019 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:56.682019 (+ 4000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:58719: BlockingRecv error: recv got EOF from 127.7.153.2:58719 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 06 16:57:56 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:56 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:56.915613 17623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:56.909837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:33105)
0806 16:57:56.910126 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:56.910139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:56.910241 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:56.910495 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:56.910497 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:56.910682 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:56.910779 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:56.910785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.911647 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.911649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:56.912209 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:56.912217 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.912749 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.912756 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:56.912826 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:56.913366 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:56.913378 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:56.915376 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":107,"threads_started":1}
W20260806 16:57:56.915722 17620 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:56.909927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:33105 (local address 127.7.153.62:40287)
0806 16:57:56.910092 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:56.910096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:56.910213 (+ 117us) server_negotiation.cc:407] Connection header received
0806 16:57:56.910328 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:56.910330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:56.910380 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:56.910457 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:56.910925 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.911512 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.912332 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:56.912574 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:56.912682 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:56.915541 (+ 2859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:33105: BlockingRecv error: recv got EOF from 127.7.153.3:33105 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 16:57:57 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:57 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:57.471220 17624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:57.464120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:35469)
0806 16:57:57.464432 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:57.464456 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:57.464561 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:57.465015 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:57.465018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:57.465247 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:57.465359 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:57.465365 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.466307 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.466310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:57.466905 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:57.466916 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.467458 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.467462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:57.467558 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:57.468137 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:57.468149 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:57.471002 (+ 2853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":111,"threads_started":1}
W20260806 16:57:57.471357 17625 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:57.464333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:35469 (local address 127.7.153.62:40287)
0806 16:57:57.464594 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:57.464598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:57.464613 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:57:57.464672 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:57.464675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:57.464745 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:57.464842 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:57.465509 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.466158 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.467059 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.467330 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.467450 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:57.471212 (+ 3762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:35469: BlockingRecv error: recv got EOF from 127.7.153.1:35469 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
Aug 06 16:57:57 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:57 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:57.689440 17626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:57.683114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:57463)
0806 16:57:57.683424 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:57.683446 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:57.683591 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:57.683883 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:57.683886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:57.684125 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:57.684225 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:57.684231 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.685090 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.685095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:57.685660 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:57.685668 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.686144 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.686147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:57.686232 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:57.686924 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:57.686938 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:57.689316 (+ 2378us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":94,"threads_started":1}
W20260806 16:57:57.689672 17625 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:57.683217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:57463 (local address 127.7.153.62:40287)
0806 16:57:57.683394 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:57.683399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:57.683525 (+ 126us) server_negotiation.cc:407] Connection header received
0806 16:57:57.683723 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:57.683726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:57.683773 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:57.683863 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:57.684349 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.684977 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.685787 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.686015 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.686130 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:57.689511 (+ 3381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:57463: BlockingRecv error: recv got EOF from 127.7.153.2:57463 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 16:57:57 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:57 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:57.922241 17627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:57.916535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:54063)
0806 16:57:57.916871 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:57.916897 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:57.917018 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:57.917295 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:57.917297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:57.917503 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:57.917607 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:57.917613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.918391 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.918394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:57.918959 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:57.918967 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.919435 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.919438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:57.919501 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:57.920050 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:57.920061 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:57.922066 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":165,"threads_started":1}
W20260806 16:57:57.922466 17625 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:57.916623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:54063 (local address 127.7.153.62:40287)
0806 16:57:57.916849 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:57.916854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:57.916977 (+ 123us) server_negotiation.cc:407] Connection header received
0806 16:57:57.917109 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:57.917111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:57.917174 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:57.917255 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:57.917719 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.918248 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.919090 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:57.919316 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:57.919406 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:57.922307 (+ 2901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:54063: BlockingRecv error: recv got EOF from 127.7.153.3:54063 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 06 16:57:58 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:58 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:58.479019 17628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:58.472301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:58807)
0806 16:57:58.472588 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:58.472602 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:58.472731 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:58.472969 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:58.472971 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:58.473168 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:58.473267 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:58.473272 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.474260 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.474265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:58.475240 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:58.475253 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.475901 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.475905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:58.476002 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:58.476628 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:58.476674 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:58.478869 (+ 2195us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":104,"threads_started":1}
W20260806 16:57:58.479207 17629 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:58.472362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:58807 (local address 127.7.153.62:40287)
0806 16:57:58.472613 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:58.472617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:58.472676 (+ 59us) server_negotiation.cc:407] Connection header received
0806 16:57:58.472829 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:58.472831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:58.472878 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:58.472959 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:58.473372 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.473970 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.475392 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.475744 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.475855 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:58.479073 (+ 3218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:58807: BlockingRecv error: recv got EOF from 127.7.153.1:58807 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
Aug 06 16:57:58 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:58 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:58.696357 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:58.690353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:48353)
0806 16:57:58.690689 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:58.690706 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:58.690860 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:58.691272 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:58.691275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:58.691470 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:58.691568 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:58.691573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.692371 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.692374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:58.692958 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:58.692966 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.693391 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.693394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:58.693459 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:58.694049 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:58.694062 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:58.696202 (+ 2140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":116,"threads_started":1}
W20260806 16:57:58.696508 17629 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:58.690548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:48353 (local address 127.7.153.62:40287)
0806 16:57:58.690693 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:58.690700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:58.690822 (+ 122us) server_negotiation.cc:407] Connection header received
0806 16:57:58.690984 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:58.690990 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:58.691056 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:58.691140 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:58.691721 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.692272 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.693063 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.693281 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.693364 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:58.696379 (+ 3015us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:48353: BlockingRecv error: recv got EOF from 127.7.153.2:48353 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 16:57:58 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:58 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:58.934899 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:58.923310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:36091)
0806 16:57:58.923611 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:58.923630 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:58.923762 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:58.924070 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:58.924073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:58.924330 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:58.924456 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:58.924463 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.925342 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.925345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:58.925912 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:58.925920 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.926367 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.926370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:58.926435 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:58.932291 (+ 5856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:58.932310 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:58.934680 (+ 2370us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":114,"threads_started":1}
W20260806 16:57:58.935161 17629 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:58.923408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:36091 (local address 127.7.153.62:40287)
0806 16:57:58.923566 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:58.923570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:58.923752 (+ 182us) server_negotiation.cc:407] Connection header received
0806 16:57:58.923888 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:58.923891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:58.923941 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:58.924018 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:58.924620 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.925238 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.926021 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:58.926238 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:58.926316 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:58.935027 (+ 8711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:36091: BlockingRecv error: recv got EOF from 127.7.153.3:36091 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 06 16:57:59 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:59 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:59.486981 17632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:59.480212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:40305)
0806 16:57:59.480484 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:59.480502 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:59.480623 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:59.481094 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:59.481097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:59.481328 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:59.481426 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:59.481432 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.482236 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.482239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:59.482847 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:59.482855 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.483357 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.483360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:59.483449 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:59.484222 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:59.484238 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:59.486835 (+ 2597us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":94,"threads_started":1}
W20260806 16:57:59.487241 17633 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:59.480366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:40305 (local address 127.7.153.62:40287)
0806 16:57:59.480867 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:59.480871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:59.480882 (+ 11us) server_negotiation.cc:407] Connection header received
0806 16:57:59.480922 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:59.480925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:59.480965 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:59.481070 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:59.481551 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.482113 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.482981 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.483226 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.483346 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:59.487091 (+ 3745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:40305: BlockingRecv error: recv got EOF from 127.7.153.1:40305 (error 108)
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":125,"threads_started":1}
Aug 06 16:57:59 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:59 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:59.703467 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:59.697566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:48363)
0806 16:57:59.697913 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:59.697938 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:59.698049 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:59.698398 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:59.698400 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:59.698597 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:59.698718 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:59.698723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.699494 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.699496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:59.700086 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:59.700095 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.700564 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.700567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:59.700654 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:59.701306 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:59.701319 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:59.703263 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":155,"threads_started":1}
W20260806 16:57:59.703526 17633 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:59.697771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:48363 (local address 127.7.153.62:40287)
0806 16:57:59.697931 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:59.697935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:59.698012 (+ 77us) server_negotiation.cc:407] Connection header received
0806 16:57:59.698131 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:59.698134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:59.698190 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:59.698274 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:59.698846 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.699385 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.700214 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.700430 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.700528 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:59.703409 (+ 2881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:48363: BlockingRecv error: recv got EOF from 127.7.153.2:48363 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 16:57:59 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:57:59 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.3@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:57:59.942381 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:57:59.935903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.3:52631)
0806 16:57:59.936278 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0806 16:57:59.936291 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:57:59.936432 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:57:59.936804 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:57:59.936807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:57:59.937090 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:57:59.937257 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:59.937265 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.938081 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.938084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:59.938759 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:57:59.938769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.939266 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.939268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:57:59.939370 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:59.939962 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:57:59.939980 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:57:59.942239 (+ 2259us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":96,"threads_started":1}
W20260806 16:57:59.942612 17633 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:57:59.936035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:52631 (local address 127.7.153.62:40287)
0806 16:57:59.936188 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 16:57:59.936193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:57:59.936380 (+ 187us) server_negotiation.cc:407] Connection header received
0806 16:57:59.936546 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:57:59.936550 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:57:59.936610 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:57:59.936767 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:57:59.937400 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.937976 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.938904 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:57:59.939155 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:57:59.939242 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:57:59.942414 (+ 3172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.3:52631: BlockingRecv error: recv got EOF from 127.7.153.3:52631 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 16:58:00 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:58:00 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.1@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:58:00.498890 17638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:00.488419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.1:41867)
0806 16:58:00.488933 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:00.488976 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:00.489130 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:00.489567 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:00.489570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:00.489889 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:00.490051 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:00.490059 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.491256 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.491264 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:00.492286 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:00.492301 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.493141 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.493157 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:00.493280 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:00.494112 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:00.494140 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:00.498562 (+ 4422us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":174,"threads_started":1}
W20260806 16:58:00.499115 17639 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:58:00.488505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:41867 (local address 127.7.153.62:40287)
0806 16:58:00.489051 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:00.489056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:00.489081 (+ 25us) server_negotiation.cc:407] Connection header received
0806 16:58:00.489294 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:00.489296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:00.489364 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:00.489512 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:00.490235 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.491062 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.492468 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.492912 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.493139 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:00.498845 (+ 5706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.1:41867: BlockingRecv error: recv got EOF from 127.7.153.1:41867 (error 108)
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":198,"threads_started":1}
Aug 06 16:58:00 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
Aug 06 16:58:00 dist-test-slave-cbsf krb5kdc[16506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.153.2@KRBTEST.COM for oryx/127.7.153.62@KRBTEST.COM, Server not found in Kerberos database
I20260806 16:58:00.710764 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:00.704592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:40287 (local address 127.7.153.2:48701)
0806 16:58:00.704984 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:00.704999 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:00.705107 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:00.705361 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:00.705363 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:00.705556 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:00.705660 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:00.705665 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.706453 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.706455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:00.707028 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:00.707036 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.707583 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.707586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:00.707706 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:00.708460 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:00.708472 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:00.710636 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.153.62:40287: Server oryx/127.7.153.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":176,"threads_started":1}
W20260806 16:58:00.710989 17639 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:58:00.704792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:48701 (local address 127.7.153.62:40287)
0806 16:58:00.705003 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:00.705007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:00.705077 (+ 70us) server_negotiation.cc:407] Connection header received
0806 16:58:00.705194 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:00.705197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:00.705246 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:00.705319 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:00.705779 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.706343 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.707153 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:00.707448 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:00.707559 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:00.710848 (+ 3289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.153.2:48701: BlockingRecv error: recv got EOF from 127.7.153.2:48701 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 16:58:00.804064 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17130
I20260806 16:58:00.812781 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17293
I20260806 16:58:00.821717 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17436
I20260806 16:58:00.831596 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17055
2026-08-06T16:58:00Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18435 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T16:58:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:58:00Z Disabled control of system clock
I20260806 16:58:00.872653 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34351
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 16:58:01.005168 17645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:01.005486 17645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:01.005524 17645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:01.009991 17645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:58:01.010078 17645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:01.010094 17645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:01.010113 17645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:58:01.010129 17645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:58:01.015556 17645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:01.017040 17645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:01.018683 17645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:01.028658 17650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:01.028676 17651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.028736 17645 server_base.cc:1034] running on GCE node
W20260806 16:58:01.028658 17653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.029587 17645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:01.030913 17645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:01.032181 17645 hybrid_clock.cc:648] HybridClock initialized: now 1786035481032151 us; error 51 us; skew 500 ppm
I20260806 16:58:01.034440 17645 webserver.cc:460] Webserver started at http://127.7.153.62:43673/ using document root <none> and password file <none>
I20260806 16:58:01.035171 17645 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:01.035290 17645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:01.035542 17645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:01.037943 17645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "ee7da4c7724147409c57acdf0d5b2f02"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "e6e8f7400892d2376279e869de94f60d"
server_key_iv: "31cc95b57461678537b04ad1b23ffa7e"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.038615 17645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "ee7da4c7724147409c57acdf0d5b2f02"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "e6e8f7400892d2376279e869de94f60d"
server_key_iv: "31cc95b57461678537b04ad1b23ffa7e"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.043818 17645 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 16:58:01.046854 17659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.048471 17645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 16:58:01.048656 17645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "ee7da4c7724147409c57acdf0d5b2f02"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "e6e8f7400892d2376279e869de94f60d"
server_key_iv: "31cc95b57461678537b04ad1b23ffa7e"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.048870 17645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:01.069561 17645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:01.070427 17645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:01.070668 17645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:01.079429 17715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34351 every 8 connection(s)
I20260806 16:58:01.079427 17645 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34351
I20260806 16:58:01.081178 17645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:58:01.085031 17716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:01.091406 17716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02: Bootstrap starting.
I20260806 16:58:01.091756 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17645
I20260806 16:58:01.091926 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:58:01.092315 7780 external_mini_cluster.cc:1428] Setting key ccc2dd6a22b8f81d4853c243f4bedc27
I20260806 16:58:01.094784 17716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:01.095671 17716 log.cc:824] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:01.098630 17716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02: No bootstrap required, opened a new log
I20260806 16:58:01.102977 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.094139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58372 (local address 127.7.153.62:34351)
0806 16:58:01.094956 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:01.094978 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:01.095029 (+ 51us) server_negotiation.cc:407] Connection header received
0806 16:58:01.095755 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:01.095774 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:01.096347 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:01.096817 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:01.097319 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.098330 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.099336 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.099843 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.100042 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.101059 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:01.101065 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:01.101080 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:01.101504 (+ 424us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:01.101566 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:01.101588 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:01.101714 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:01.101849 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 16:58:01.102140 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":162,"threads_started":1}
I20260806 16:58:01.102949 17716 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7da4c7724147409c57acdf0d5b2f02" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34351 } }
I20260806 16:58:01.103332 17716 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:01.103473 17716 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee7da4c7724147409c57acdf0d5b2f02, State: Initialized, Role: FOLLOWER
I20260806 16:58:01.104013 17716 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7da4c7724147409c57acdf0d5b2f02" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34351 } }
I20260806 16:58:01.104197 17716 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:58:01.104274 17716 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:58:01.104401 17716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:01.106287 17716 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7da4c7724147409c57acdf0d5b2f02" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34351 } }
I20260806 16:58:01.106698 17716 leader_election.cc:302] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee7da4c7724147409c57acdf0d5b2f02; no voters:
I20260806 16:58:01.107051 17716 leader_election.cc:288] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:58:01.107261 17721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:58:01.107527 17721 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [term 1 LEADER]: Becoming Leader. State: Replica: ee7da4c7724147409c57acdf0d5b2f02, State: Running, Role: LEADER
I20260806 16:58:01.107932 17721 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7da4c7724147409c57acdf0d5b2f02" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34351 } }
I20260806 16:58:01.109202 17716 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:58:01.109911 17722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee7da4c7724147409c57acdf0d5b2f02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7da4c7724147409c57acdf0d5b2f02" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34351 } } }
I20260806 16:58:01.110090 17722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:01.109928 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee7da4c7724147409c57acdf0d5b2f02. Latest consensus state: current_term: 1 leader_uuid: "ee7da4c7724147409c57acdf0d5b2f02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7da4c7724147409c57acdf0d5b2f02" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34351 } } }
I20260806 16:58:01.110636 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02 [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:01.112092 17725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:58:01.115259 17725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:58:01.121781 17725 catalog_manager.cc:1347] Generated new cluster ID: 70f4381369504d7aa90d017e16eb04fb
I20260806 16:58:01.121888 17725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:58:01.166347 17725 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:58:01.167419 17725 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:58:01.175916 17725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee7da4c7724147409c57acdf0d5b2f02: Generated new TSK 0
I20260806 16:58:01.176805 17725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:58:01.188145 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34351
--builtin_ntp_servers=127.7.153.20:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 16:58:01.316831 17740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:01.317196 17740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:01.317276 17740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:01.321602 17740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:01.321699 17740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:01.321795 17740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:58:01.327056 17740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:01.328322 17740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:01.329926 17740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:01.340601 17745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:01.340689 17746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:01.340601 17748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.340848 17740 server_base.cc:1034] running on GCE node
I20260806 16:58:01.341392 17740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:01.342135 17740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:01.343532 17740 hybrid_clock.cc:648] HybridClock initialized: now 1786035481343483 us; error 82 us; skew 500 ppm
I20260806 16:58:01.345839 17740 webserver.cc:460] Webserver started at http://127.7.153.1:38779/ using document root <none> and password file <none>
I20260806 16:58:01.346518 17740 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:01.346647 17740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:01.346897 17740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:01.349354 17740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "e353539e04194e9b81b2a415b28714ab"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "4f71d9790b5a6bf3cb783414b83a257e"
server_key_iv: "9d37060d67c7734f208f46e3ec4dc87c"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.350009 17740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "e353539e04194e9b81b2a415b28714ab"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "4f71d9790b5a6bf3cb783414b83a257e"
server_key_iv: "9d37060d67c7734f208f46e3ec4dc87c"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.354312 17740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:58:01.357333 17754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.358700 17740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:58:01.358870 17740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "e353539e04194e9b81b2a415b28714ab"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "4f71d9790b5a6bf3cb783414b83a257e"
server_key_iv: "9d37060d67c7734f208f46e3ec4dc87c"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.358986 17740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:01.377751 17740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:01.378507 17740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:01.378690 17740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:01.379267 17740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:01.380249 17740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:01.380299 17740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.380344 17740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:01.380359 17740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.389881 17740 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:39901
I20260806 16:58:01.389901 17873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:39901 every 8 connection(s)
I20260806 16:58:01.390959 17740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:58:01.397401 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17740
I20260806 16:58:01.397552 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:58:01.397926 7780 external_mini_cluster.cc:1428] Setting key 655bf353217041d9e1521e3e92100f54
I20260806 16:58:01.400199 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34351
--builtin_ntp_servers=127.7.153.20:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 16:58:01.401288 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.392966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:36267 (local address 127.7.153.62:34351)
0806 16:58:01.393110 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:01.393114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:01.394224 (+ 1110us) server_negotiation.cc:407] Connection header received
0806 16:58:01.395624 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:01.395627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:01.395675 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:01.395755 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:01.396758 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.397325 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.398980 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.399335 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.399445 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.400803 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:01.400806 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:01.400808 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:01.400821 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:01.400840 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:01.400848 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:01.400909 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:01.401110 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 16:58:01.401172 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:58:01.402547 17876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.393364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34351 (local address 127.7.153.1:36267)
0806 16:58:01.394061 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:01.394106 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:01.395412 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:01.395917 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:01.395924 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:01.396014 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:01.396538 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:01.396551 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.397473 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.397479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:01.398854 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:01.398864 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.399521 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.399526 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:01.399753 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.400444 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:58:01.400448 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:01.400509 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:58:01.400616 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:01.400938 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:01.400951 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:01.400960 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 16:58:01.401103 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 16:58:01.401459 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":120,"threads_started":1}
I20260806 16:58:01.403939 17874 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34351
I20260806 16:58:01.404234 17874 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:01.405011 17874 heartbeater.cc:511] Master 127.7.153.62:34351 requested a full tablet report, sending...
I20260806 16:58:01.407177 17676 ts_manager.cc:194] Registered new tserver with Master: e353539e04194e9b81b2a415b28714ab (127.7.153.1:39901)
I20260806 16:58:01.408527 17676 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.1:36267
W20260806 16:58:01.524802 17877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:01.525105 17877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:01.525143 17877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:01.529225 17877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:01.529286 17877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:01.529342 17877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:58:01.534448 17877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:01.535593 17877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:01.537191 17877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:01.547576 17883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.547700 17877 server_base.cc:1034] running on GCE node
W20260806 16:58:01.547626 17885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:01.547637 17882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.548467 17877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:01.549239 17877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:01.550415 17877 hybrid_clock.cc:648] HybridClock initialized: now 1786035481550396 us; error 32 us; skew 500 ppm
I20260806 16:58:01.552436 17877 webserver.cc:460] Webserver started at http://127.7.153.2:40637/ using document root <none> and password file <none>
I20260806 16:58:01.553171 17877 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:01.553283 17877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:01.553517 17877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:01.555787 17877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "8437ff0f08b2457ea9ec10338a55740a"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "fa519e5f1dc34e6b3ca61ad8495b71c7"
server_key_iv: "8dca55c37977c078a191187e34c04fa7"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.556381 17877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "8437ff0f08b2457ea9ec10338a55740a"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "fa519e5f1dc34e6b3ca61ad8495b71c7"
server_key_iv: "8dca55c37977c078a191187e34c04fa7"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.560388 17877 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 16:58:01.563336 17891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.564594 17877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:58:01.564778 17877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "8437ff0f08b2457ea9ec10338a55740a"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "fa519e5f1dc34e6b3ca61ad8495b71c7"
server_key_iv: "8dca55c37977c078a191187e34c04fa7"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.564944 17877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:01.593796 17877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:01.594662 17877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:01.594895 17877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:01.595580 17877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:01.596668 17877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:01.596760 17877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.596835 17877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:01.596889 17877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.606623 17877 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:42133
I20260806 16:58:01.606652 18010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:42133 every 8 connection(s)
I20260806 16:58:01.607635 17877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:58:01.609382 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 17877
I20260806 16:58:01.609498 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:58:01.609844 7780 external_mini_cluster.cc:1428] Setting key d07bb47537e96441168c30f263715bed
I20260806 16:58:01.611912 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34351
--builtin_ntp_servers=127.7.153.20:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 16:58:01.618031 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.609708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:51987 (local address 127.7.153.62:34351)
0806 16:58:01.609840 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:01.609845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:01.611307 (+ 1462us) server_negotiation.cc:407] Connection header received
0806 16:58:01.612970 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:01.612974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:01.613026 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:01.613111 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:01.614070 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.614644 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.615847 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.616101 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.616219 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.617496 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:01.617500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:01.617503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:01.617526 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:01.617546 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:01.617554 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:01.617632 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:01.617804 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 16:58:01.617873 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:58:01.618994 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.610287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34351 (local address 127.7.153.2:51987)
0806 16:58:01.611124 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:01.611180 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:01.612736 (+ 1556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:01.613289 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:01.613297 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:01.613386 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:01.613911 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:01.613924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.614786 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.614794 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:01.615711 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:01.615721 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.616271 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.616275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:01.616452 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.617200 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:58:01.617202 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:01.617246 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:58:01.617319 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:01.617646 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:01.617662 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:01.617669 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 16:58:01.617804 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 16:58:01.618137 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":147,"threads_started":1}
I20260806 16:58:01.620491 18011 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34351
I20260806 16:58:01.620800 18011 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:01.621405 18011 heartbeater.cc:511] Master 127.7.153.62:34351 requested a full tablet report, sending...
I20260806 16:58:01.622674 17676 ts_manager.cc:194] Registered new tserver with Master: 8437ff0f08b2457ea9ec10338a55740a (127.7.153.2:42133)
I20260806 16:58:01.623606 17676 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.2:51987
W20260806 16:58:01.733801 18014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:01.734122 18014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:01.734161 18014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:01.738531 18014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:01.738600 18014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:01.738659 18014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:58:01.744020 18014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:01.745204 18014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:01.746582 18014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:01.756958 18019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.757179 18014 server_base.cc:1034] running on GCE node
W20260806 16:58:01.756986 18022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:01.756986 18020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:01.757863 18014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:01.758564 18014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:01.759743 18014 hybrid_clock.cc:648] HybridClock initialized: now 1786035481759726 us; error 29 us; skew 500 ppm
I20260806 16:58:01.761791 18014 webserver.cc:460] Webserver started at http://127.7.153.3:43197/ using document root <none> and password file <none>
I20260806 16:58:01.762425 18014 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:01.762493 18014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:01.762744 18014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:01.765196 18014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "cefa28cd06494d08a1eb89352b1a3639"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "bbb579f962f972f51112152be0a942fe"
server_key_iv: "ac471b4ebeff9ee6fc90298fa4851a39"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.765808 18014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "cefa28cd06494d08a1eb89352b1a3639"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "bbb579f962f972f51112152be0a942fe"
server_key_iv: "ac471b4ebeff9ee6fc90298fa4851a39"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.770414 18014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:58:01.773288 18028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.774699 18014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:58:01.774873 18014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "cefa28cd06494d08a1eb89352b1a3639"
format_stamp: "Formatted at 2026-08-06 16:58:01 on dist-test-slave-cbsf"
server_key: "bbb579f962f972f51112152be0a942fe"
server_key_iv: "ac471b4ebeff9ee6fc90298fa4851a39"
server_key_version: "encryptionkey@0"
I20260806 16:58:01.775009 18014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:01.788939 18014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:01.789737 18014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:01.789915 18014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:01.790617 18014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:01.791654 18014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:01.791706 18014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.791749 18014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:01.791790 18014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:01.801870 18014 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:38557
I20260806 16:58:01.801888 18149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:38557 every 8 connection(s)
I20260806 16:58:01.802892 18014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:58:01.810573 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18014
I20260806 16:58:01.810745 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:58:01.811084 7780 external_mini_cluster.cc:1428] Setting key 919f53d348d358df3b383f01ca8368d4
I20260806 16:58:01.813952 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.804989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:38559 (local address 127.7.153.62:34351)
0806 16:58:01.805144 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:01.805148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:01.806313 (+ 1165us) server_negotiation.cc:407] Connection header received
0806 16:58:01.807796 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:01.807800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:01.807860 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:01.807968 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:01.809068 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.809694 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.811178 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.811430 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.811585 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.813243 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:01.813247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:01.813250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:01.813265 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:01.813290 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:01.813302 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:01.813390 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:01.813761 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 16:58:01.813834 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 16:58:01.815056 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:01.805425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34351 (local address 127.7.153.3:38559)
0806 16:58:01.806139 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:01.806183 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:01.807556 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:01.808180 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:01.808187 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:01.808278 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:01.808906 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:01.808923 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.809828 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.809831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:01.811034 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:01.811046 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:01.811673 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:01.811679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:01.811916 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:01.812739 (+ 823us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:58:01.812743 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:01.812808 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:58:01.812982 (+ 174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:01.813573 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:01.813583 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:01.813589 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 16:58:01.813708 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 16:58:01.814133 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":117,"threads_started":1}
I20260806 16:58:01.816411 18150 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34351
I20260806 16:58:01.816718 18150 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:01.817363 18150 heartbeater.cc:511] Master 127.7.153.62:34351 requested a full tablet report, sending...
I20260806 16:58:01.818662 17676 ts_manager.cc:194] Registered new tserver with Master: cefa28cd06494d08a1eb89352b1a3639 (127.7.153.3:38557)
I20260806 16:58:01.819322 17676 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.3:38559
I20260806 16:58:01.826079 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 16:58:01.829591 17719 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:58:01.828230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58378 (local address 127.7.153.62:34351)
0806 16:58:01.828558 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:01.828564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:01.828818 (+ 254us) server_negotiation.cc:407] Connection header received
0806 16:58:01.828959 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:01.828962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:01.829009 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:01.829084 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:01.829446 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58378: BlockingRecv error: recv got EOF from 127.0.0.1:58378 (error 108)
Metrics: {"server-negotiator.queue_time_us":222}
I20260806 16:58:01.829747 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17740
I20260806 16:58:01.838306 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17877
I20260806 16:58:01.847842 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18014
I20260806 16:58:01.856542 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 17645
2026-08-06T16:58:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1021 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T16:58:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:58:01Z Disabled control of system clock
I20260806 16:58:01.890259 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44451
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:38701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:44451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 16:58:02.013593 18162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:02.013918 18162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:02.013958 18162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:02.018200 18162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:58:02.018277 18162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:02.018294 18162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:02.018312 18162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:58:02.018328 18162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:58:02.023514 18162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:44451
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:02.024834 18162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:02.026369 18162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:02.035983 18167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:02.035957 18170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:02.035960 18168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:02.036389 18162 server_base.cc:1034] running on GCE node
I20260806 16:58:02.037070 18162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:02.038432 18162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:02.039614 18162 hybrid_clock.cc:648] HybridClock initialized: now 1786035482039583 us; error 50 us; skew 500 ppm
I20260806 16:58:02.042361 18162 webserver.cc:460] Webserver started at http://127.7.153.62:36613/ using document root <none> and password file <none>
I20260806 16:58:02.043097 18162 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:02.043174 18162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:02.043462 18162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:02.046017 18162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "a305e9309df342cfb4b985206211b1b7"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "e7ed4e16f2193b6235adbed99c1ed8e2"
server_key_iv: "dddd467a1665a5d712a19e33911fa9e1"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.046676 18162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "a305e9309df342cfb4b985206211b1b7"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "e7ed4e16f2193b6235adbed99c1ed8e2"
server_key_iv: "dddd467a1665a5d712a19e33911fa9e1"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.051188 18162 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:58:02.054237 18176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.055773 18162 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:58:02.056054 18162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "a305e9309df342cfb4b985206211b1b7"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "e7ed4e16f2193b6235adbed99c1ed8e2"
server_key_iv: "dddd467a1665a5d712a19e33911fa9e1"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.056208 18162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:02.062054 18162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:02.062832 18162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:02.063071 18162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:02.071158 18162 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:44451
I20260806 16:58:02.071173 18231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:44451 every 8 connection(s)
I20260806 16:58:02.072316 18162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:58:02.076154 18234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:02.077986 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18162
I20260806 16:58:02.078154 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:58:02.078491 7780 external_mini_cluster.cc:1428] Setting key cdc7643cd83311481f8794f3b634f2c8
I20260806 16:58:02.083842 18234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7: Bootstrap starting.
I20260806 16:58:02.084916 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.080171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57080 (local address 127.7.153.62:44451)
0806 16:58:02.080966 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:02.080984 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:02.081032 (+ 48us) server_negotiation.cc:407] Connection header received
0806 16:58:02.081766 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:02.081785 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:02.082185 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:02.082499 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:02.083413 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:02.083418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:02.083431 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:02.083442 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:02.083506 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:02.083523 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:02.083651 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:02.083751 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 16:58:02.084068 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":163,"threads_started":1}
I20260806 16:58:02.086632 18234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:02.087589 18234 log.cc:824] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:02.089973 18234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7: No bootstrap required, opened a new log
I20260806 16:58:02.093873 18234 raft_consensus.cc:348] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a305e9309df342cfb4b985206211b1b7" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44451 } }
I20260806 16:58:02.094190 18234 raft_consensus.cc:374] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:02.094276 18234 raft_consensus.cc:729] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a305e9309df342cfb4b985206211b1b7, State: Initialized, Role: FOLLOWER
I20260806 16:58:02.094765 18234 consensus_queue.cc:260] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a305e9309df342cfb4b985206211b1b7" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44451 } }
I20260806 16:58:02.094930 18234 raft_consensus.cc:388] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:58:02.095033 18234 raft_consensus.cc:482] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:58:02.095165 18234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:02.097204 18234 raft_consensus.cc:504] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a305e9309df342cfb4b985206211b1b7" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44451 } }
I20260806 16:58:02.097636 18234 leader_election.cc:302] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a305e9309df342cfb4b985206211b1b7; no voters:
I20260806 16:58:02.098033 18234 leader_election.cc:288] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:58:02.098191 18240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:58:02.098479 18240 raft_consensus.cc:686] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [term 1 LEADER]: Becoming Leader. State: Replica: a305e9309df342cfb4b985206211b1b7, State: Running, Role: LEADER
I20260806 16:58:02.098901 18240 consensus_queue.cc:237] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a305e9309df342cfb4b985206211b1b7" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44451 } }
I20260806 16:58:02.099535 18234 sys_catalog.cc:564] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:58:02.101209 18242 sys_catalog.cc:455] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a305e9309df342cfb4b985206211b1b7. Latest consensus state: current_term: 1 leader_uuid: "a305e9309df342cfb4b985206211b1b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a305e9309df342cfb4b985206211b1b7" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44451 } } }
I20260806 16:58:02.101387 18242 sys_catalog.cc:458] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:02.101778 18241 sys_catalog.cc:455] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a305e9309df342cfb4b985206211b1b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a305e9309df342cfb4b985206211b1b7" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44451 } } }
I20260806 16:58:02.102329 18241 sys_catalog.cc:458] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7 [sys.catalog]: This master's current role is: LEADER
W20260806 16:58:02.104943 18256 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:58:02.105038 18256 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:58:02.105127 18254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:58:02.105856 18254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:58:02.111846 18254 catalog_manager.cc:1347] Generated new cluster ID: 1cf8b8af550941a8aa29057a7afe2ada
I20260806 16:58:02.111950 18254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:58:02.124392 18254 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:58:02.124897 18254 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:58:02.135946 18254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a305e9309df342cfb4b985206211b1b7: Generated new TSK 0
I20260806 16:58:02.136979 18254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:58:02.151248 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44451
--builtin_ntp_servers=127.7.153.20:38701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 16:58:02.273823 18260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:02.274134 18260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:02.274176 18260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:02.278450 18260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:02.278528 18260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:02.278590 18260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:58:02.283815 18260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:02.285094 18260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:02.286580 18260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:02.296861 18266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:02.296860 18268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:02.296872 18265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:02.297291 18260 server_base.cc:1034] running on GCE node
I20260806 16:58:02.297713 18260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:02.298435 18260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:02.299620 18260 hybrid_clock.cc:648] HybridClock initialized: now 1786035482299603 us; error 32 us; skew 500 ppm
I20260806 16:58:02.301755 18260 webserver.cc:460] Webserver started at http://127.7.153.1:37823/ using document root <none> and password file <none>
I20260806 16:58:02.302332 18260 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:02.302397 18260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:02.302578 18260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:02.304791 18260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "ce1d81ea53a84cca8b727c6704c2cb8e"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "91e0bdcd611ed0466b143265287fc245"
server_key_iv: "6329467767075e5a726c8a789bdaf75f"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.305367 18260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "ce1d81ea53a84cca8b727c6704c2cb8e"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "91e0bdcd611ed0466b143265287fc245"
server_key_iv: "6329467767075e5a726c8a789bdaf75f"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.309465 18260 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:58:02.313160 18274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.314594 18260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 16:58:02.314757 18260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "ce1d81ea53a84cca8b727c6704c2cb8e"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "91e0bdcd611ed0466b143265287fc245"
server_key_iv: "6329467767075e5a726c8a789bdaf75f"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.314913 18260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:02.320079 18260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:02.320817 18260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:02.321018 18260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:02.321626 18260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:02.322628 18260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:02.322674 18260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.322712 18260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:02.322753 18260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.332041 18260 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:38749
I20260806 16:58:02.332134 18392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:38749 every 8 connection(s)
I20260806 16:58:02.333129 18260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:58:02.339716 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18260
I20260806 16:58:02.339856 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:58:02.340261 7780 external_mini_cluster.cc:1428] Setting key bbca97e74b34fa6c413e184f0255e86f
I20260806 16:58:02.340404 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.335330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:58451 (local address 127.7.153.62:44451)
0806 16:58:02.335484 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:02.335489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:02.336617 (+ 1128us) server_negotiation.cc:407] Connection header received
0806 16:58:02.338168 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:02.338174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:02.338235 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:02.338323 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:02.339698 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:02.339704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:02.339708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:02.339723 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:02.339751 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:02.339762 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:02.339882 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:02.340192 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 16:58:02.340249 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 16:58:02.341809 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.335745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44451 (local address 127.7.153.1:58451)
0806 16:58:02.336460 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:02.336502 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:02.337876 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:02.338517 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:02.338524 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:02.338631 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:02.339394 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:58:02.339396 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:02.339440 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:58:02.339520 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:02.340008 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:02.340021 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:02.340030 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 16:58:02.340210 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 16:58:02.340530 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":127,"threads_started":1}
I20260806 16:58:02.342916 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44451
--builtin_ntp_servers=127.7.153.20:38701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 16:58:02.343299 18394 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44451
I20260806 16:58:02.343565 18394 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:02.344094 18394 heartbeater.cc:511] Master 127.7.153.62:44451 requested a full tablet report, sending...
I20260806 16:58:02.346194 18193 ts_manager.cc:194] Registered new tserver with Master: ce1d81ea53a84cca8b727c6704c2cb8e (127.7.153.1:38749)
W20260806 16:58:02.464290 18398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:02.464656 18398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:02.464775 18398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:02.469133 18398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:02.469233 18398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:02.469324 18398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:58:02.474486 18398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:02.475800 18398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:02.477376 18398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:02.488081 18404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:02.488210 18403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:02.488299 18398 server_base.cc:1034] running on GCE node
W20260806 16:58:02.488222 18406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:02.488900 18398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:02.489681 18398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:02.490921 18398 hybrid_clock.cc:648] HybridClock initialized: now 1786035482490882 us; error 52 us; skew 500 ppm
I20260806 16:58:02.494452 18398 webserver.cc:460] Webserver started at http://127.7.153.2:46865/ using document root <none> and password file <none>
I20260806 16:58:02.495270 18398 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:02.495376 18398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:02.495612 18398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:02.497982 18398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "b96f535f0d04479eae7b22a926bce819"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "f227f18015d9e8b9d3de661a06d1d1a5"
server_key_iv: "420da7863acd0c3adf3343b2e22b5e76"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.498726 18398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "b96f535f0d04479eae7b22a926bce819"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "f227f18015d9e8b9d3de661a06d1d1a5"
server_key_iv: "420da7863acd0c3adf3343b2e22b5e76"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.504498 18398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 16:58:02.507916 18413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.509644 18398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:58:02.509814 18398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "b96f535f0d04479eae7b22a926bce819"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "f227f18015d9e8b9d3de661a06d1d1a5"
server_key_iv: "420da7863acd0c3adf3343b2e22b5e76"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.509960 18398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:02.515091 18398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:02.516106 18398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:02.516539 18398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:02.517338 18398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:02.518484 18398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:02.518556 18398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.518633 18398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:02.518684 18398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.529002 18398 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:44141
I20260806 16:58:02.529047 18532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:44141 every 8 connection(s)
I20260806 16:58:02.530040 18398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:58:02.532158 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18398
I20260806 16:58:02.532305 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:58:02.532648 7780 external_mini_cluster.cc:1428] Setting key d80ddbaa3ff3c293f9f44c302cfbfb8f
I20260806 16:58:02.534777 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44451
--builtin_ntp_servers=127.7.153.20:38701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 16:58:02.537271 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.532285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:49121 (local address 127.7.153.62:44451)
0806 16:58:02.532421 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:02.532425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:02.533860 (+ 1435us) server_negotiation.cc:407] Connection header received
0806 16:58:02.535329 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:02.535333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:02.535379 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:02.535469 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:02.536686 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:02.536723 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:02.536727 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:02.536741 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:02.536765 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:02.536775 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:02.536891 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:02.537053 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 16:58:02.537104 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 16:58:02.538239 18535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.532851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44451 (local address 127.7.153.2:49121)
0806 16:58:02.533685 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:02.533742 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:02.535093 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:02.535642 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:02.535649 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:02.535747 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:02.536401 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:58:02.536403 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:02.536446 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:58:02.536525 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:02.536874 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:02.536883 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:02.536889 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 16:58:02.537102 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 16:58:02.537388 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":172,"threads_started":1}
I20260806 16:58:02.539928 18533 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44451
I20260806 16:58:02.540261 18533 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:02.540911 18533 heartbeater.cc:511] Master 127.7.153.62:44451 requested a full tablet report, sending...
I20260806 16:58:02.542397 18193 ts_manager.cc:194] Registered new tserver with Master: b96f535f0d04479eae7b22a926bce819 (127.7.153.2:44141)
W20260806 16:58:02.657249 18536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:02.657569 18536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:02.657660 18536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:02.662084 18536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:02.662163 18536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:02.662254 18536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:58:02.667347 18536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:38701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:02.668645 18536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:02.670137 18536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:02.680577 18542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:02.680577 18541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:02.680781 18536 server_base.cc:1034] running on GCE node
W20260806 16:58:02.680612 18545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:02.681378 18536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:02.682132 18536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:02.683298 18536 hybrid_clock.cc:648] HybridClock initialized: now 1786035482683267 us; error 60 us; skew 500 ppm
I20260806 16:58:02.685338 18536 webserver.cc:460] Webserver started at http://127.7.153.3:42397/ using document root <none> and password file <none>
I20260806 16:58:02.685949 18536 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:02.686015 18536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:02.686234 18536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:02.688419 18536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "ea91d4d3569843a6844d4f7e6f72b24a"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "103d448509bcee47cc944c0a516b1ad3"
server_key_iv: "39a971f5da18c9f668dafca6fa35df47"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.689093 18536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "ea91d4d3569843a6844d4f7e6f72b24a"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "103d448509bcee47cc944c0a516b1ad3"
server_key_iv: "39a971f5da18c9f668dafca6fa35df47"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.693244 18536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:58:02.696167 18551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.697602 18536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:58:02.697784 18536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "ea91d4d3569843a6844d4f7e6f72b24a"
format_stamp: "Formatted at 2026-08-06 16:58:02 on dist-test-slave-cbsf"
server_key: "103d448509bcee47cc944c0a516b1ad3"
server_key_iv: "39a971f5da18c9f668dafca6fa35df47"
server_key_version: "encryptionkey@0"
I20260806 16:58:02.697921 18536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:02.703322 18536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:02.704031 18536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:02.704236 18536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:02.704941 18536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:02.705940 18536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:02.706010 18536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.706075 18536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:02.706120 18536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:02.715564 18536 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:40445
I20260806 16:58:02.715585 18670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:40445 every 8 connection(s)
I20260806 16:58:02.716661 18536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:58:02.723317 18237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.718663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:47827 (local address 127.7.153.62:44451)
0806 16:58:02.718859 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:02.718864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:02.720123 (+ 1259us) server_negotiation.cc:407] Connection header received
0806 16:58:02.721538 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:02.721541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:02.721583 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:02.721663 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:02.722802 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:02.722804 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:02.722806 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 16:58:02.722819 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:02.722840 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 16:58:02.722848 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:02.722947 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:02.723144 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 16:58:02.723191 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 16:58:02.723814 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18536
I20260806 16:58:02.723908 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:58:02.724247 7780 external_mini_cluster.cc:1428] Setting key 3a176eaf2396c46de6be66207b4130f9
I20260806 16:58:02.724418 18673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:02.719213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44451 (local address 127.7.153.3:47827)
0806 16:58:02.719954 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:02.719997 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:02.721338 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:02.721836 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:02.721842 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:02.721933 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:02.722503 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 16:58:02.722505 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:02.722550 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 16:58:02.722624 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:02.722957 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:02.722966 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:02.722971 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 16:58:02.723145 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 16:58:02.723357 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":116,"threads_started":1}
I20260806 16:58:02.725747 18671 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44451
I20260806 16:58:02.726025 18671 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:02.726538 18671 heartbeater.cc:511] Master 127.7.153.62:44451 requested a full tablet report, sending...
I20260806 16:58:02.727581 18193 ts_manager.cc:194] Registered new tserver with Master: ea91d4d3569843a6844d4f7e6f72b24a (127.7.153.3:40445)
I20260806 16:58:02.739053 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 16:58:02.742466 18237 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:58:02.741304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57088 (local address 127.7.153.62:44451)
0806 16:58:02.741526 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:02.741532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:02.741687 (+ 155us) server_negotiation.cc:407] Connection header received
0806 16:58:02.741850 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:02.741855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:02.741901 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:02.741992 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:02.742304 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57088: BlockingRecv error: recv got EOF from 127.0.0.1:57088 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
I20260806 16:58:02.742759 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18260
I20260806 16:58:02.750717 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18398
I20260806 16:58:02.758963 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18536
I20260806 16:58:02.769871 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18162
2026-08-06T16:58:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (913 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:58:02 dist-test-slave-cbsf krb5kdc[18681](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:58:02 dist-test-slave-cbsf krb5kdc[18681](info): set up 2 sockets
Aug 06 16:58:02 dist-test-slave-cbsf krb5kdc[18681](info): commencing operation
krb5kdc: starting...
W20260806 16:58:03.885118 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:58:03 dist-test-slave-cbsf krb5kdc[18681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:58:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:58:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:58:04.025204 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:33639
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:33639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:58:04.158775 18696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:04.159170 18696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:04.159260 18696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:04.163563 18696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:58:04.163717 18696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:04.163760 18696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:04.163801 18696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:58:04.163837 18696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:58:04.169679 18696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:33639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:33639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:04.170974 18696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:04.172112 18696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:04.181422 18704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.181413 18701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.181413 18702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:04.181800 18696 server_base.cc:1034] running on GCE node
I20260806 16:58:04.182399 18696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:04.183651 18696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:04.184847 18696 hybrid_clock.cc:648] HybridClock initialized: now 1786035484184816 us; error 49 us; skew 500 ppm
Aug 06 16:58:04 dist-test-slave-cbsf krb5kdc[18681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035484, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:04.194176 18696 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:58:04.195381 18696 webserver.cc:460] Webserver started at http://127.7.153.62:44563/ using document root <none> and password file <none>
I20260806 16:58:04.196089 18696 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:04.196199 18696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:04.196496 18696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:04.199024 18696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "e632c186cfb44426b222f2905fb9a3b2"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "d647a3e2fe37be63cd6bd0be7aef9867"
server_key_iv: "1efa0a3ad8852620e07c8a4fa8335bd1"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.199707 18696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "e632c186cfb44426b222f2905fb9a3b2"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "d647a3e2fe37be63cd6bd0be7aef9867"
server_key_iv: "1efa0a3ad8852620e07c8a4fa8335bd1"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.204275 18696 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260806 16:58:04.207342 18711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.209084 18696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:58:04.209270 18696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "e632c186cfb44426b222f2905fb9a3b2"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "d647a3e2fe37be63cd6bd0be7aef9867"
server_key_iv: "1efa0a3ad8852620e07c8a4fa8335bd1"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.209419 18696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:04.233203 18696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:04.236970 18696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:04.237215 18696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:04.245518 18696 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:33639
I20260806 16:58:04.245862 18765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:33639 every 8 connection(s)
I20260806 16:58:04.246659 18696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:58:04.250150 18766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:04.254287 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18696
I20260806 16:58:04.254449 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:58:04.254758 7780 external_mini_cluster.cc:1428] Setting key fc6d89c8d41d9449e741fa9450c5b24d
I20260806 16:58:04.257622 18766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2: Bootstrap starting.
I20260806 16:58:04.260773 18766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:04.261821 18766 log.cc:824] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:04.264631 18766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2: No bootstrap required, opened a new log
Aug 06 16:58:04 dist-test-slave-cbsf krb5kdc[18681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:04.269418 18766 raft_consensus.cc:348] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e632c186cfb44426b222f2905fb9a3b2" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33639 } }
I20260806 16:58:04.269817 18766 raft_consensus.cc:374] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:04.269881 18766 raft_consensus.cc:729] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e632c186cfb44426b222f2905fb9a3b2, State: Initialized, Role: FOLLOWER
I20260806 16:58:04.270495 18766 consensus_queue.cc:260] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e632c186cfb44426b222f2905fb9a3b2" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33639 } }
I20260806 16:58:04.270704 18766 raft_consensus.cc:388] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:58:04.270779 18766 raft_consensus.cc:482] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:58:04.270929 18766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:04.272342 18766 raft_consensus.cc:504] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e632c186cfb44426b222f2905fb9a3b2" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33639 } }
I20260806 16:58:04.272838 18766 leader_election.cc:302] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e632c186cfb44426b222f2905fb9a3b2; no voters:
I20260806 16:58:04.273350 18766 leader_election.cc:288] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:58:04.273536 18771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:58:04.273891 18771 raft_consensus.cc:686] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [term 1 LEADER]: Becoming Leader. State: Replica: e632c186cfb44426b222f2905fb9a3b2, State: Running, Role: LEADER
I20260806 16:58:04.274284 18771 consensus_queue.cc:237] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e632c186cfb44426b222f2905fb9a3b2" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33639 } }
I20260806 16:58:04.274976 18766 sys_catalog.cc:564] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:58:04.275166 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:04.256452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48678 (local address 127.7.153.62:33639)
0806 16:58:04.256950 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:04.256972 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:04.257022 (+ 50us) server_negotiation.cc:407] Connection header received
0806 16:58:04.257996 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:04.258024 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:04.258499 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:04.258926 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:04.260215 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.261992 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.263180 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.263963 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.264157 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:04.267412 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:04.267420 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:04.267442 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:04.267485 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:04.270554 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:04.271468 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:04.271476 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:04.271484 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:04.271665 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:04.272132 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:04.272139 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:04.272144 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:04.272839 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:04.273070 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:04.273479 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 16:58:04.274058 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":181,"threads_started":1}
I20260806 16:58:04.275717 18771 sys_catalog.cc:455] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e632c186cfb44426b222f2905fb9a3b2. Latest consensus state: current_term: 1 leader_uuid: "e632c186cfb44426b222f2905fb9a3b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e632c186cfb44426b222f2905fb9a3b2" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33639 } } }
I20260806 16:58:04.275965 18771 sys_catalog.cc:458] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:04.276229 18772 sys_catalog.cc:455] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e632c186cfb44426b222f2905fb9a3b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e632c186cfb44426b222f2905fb9a3b2" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 33639 } } }
I20260806 16:58:04.276333 18772 sys_catalog.cc:458] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2 [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:04.276535 18780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:58:04.279981 18780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:58:04.286818 18780 catalog_manager.cc:1347] Generated new cluster ID: 52f8337f9444475ca53dbdad223a5c2a
I20260806 16:58:04.286919 18780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:58:04.309923 18780 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:58:04.311033 18780 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:58:04.319947 18780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2: Generated new TSK 0
I20260806 16:58:04.320851 18780 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:58:04.356477 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33639
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:58:04.478698 18792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:04.479053 18792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:04.479130 18792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:04.483440 18792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:04.483572 18792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:04.483680 18792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:58:04.489450 18792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:04.490720 18792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:04.491822 18792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:04.503012 18798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.503296 18800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.503046 18797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:04.508186 18792 server_base.cc:1034] running on GCE node
I20260806 16:58:04.508957 18792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:04.509902 18792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:04.511153 18792 hybrid_clock.cc:648] HybridClock initialized: now 1786035484511084 us; error 93 us; skew 500 ppm
Aug 06 16:58:04 dist-test-slave-cbsf krb5kdc[18681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035484, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:04.514519 18792 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:58:04.515623 18792 webserver.cc:460] Webserver started at http://127.7.153.1:44361/ using document root <none> and password file <none>
I20260806 16:58:04.516220 18792 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:04.516289 18792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:04.516474 18792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:04.518883 18792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "a0bde47bd7e74c4189c905ce6f325d38"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "3503475855b3c7f4a9b9f19ffdf573c9"
server_key_iv: "68e38bf3fbbee91142ffbce40e333e85"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.519503 18792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "a0bde47bd7e74c4189c905ce6f325d38"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "3503475855b3c7f4a9b9f19ffdf573c9"
server_key_iv: "68e38bf3fbbee91142ffbce40e333e85"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.524353 18792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 16:58:04.527376 18807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.529227 18792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:58:04.529419 18792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "a0bde47bd7e74c4189c905ce6f325d38"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "3503475855b3c7f4a9b9f19ffdf573c9"
server_key_iv: "68e38bf3fbbee91142ffbce40e333e85"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.529539 18792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:04.555136 18792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:04.558527 18792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:04.558714 18792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:04.559316 18792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:04.560189 18792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:04.560249 18792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.560292 18792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:04.560308 18792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.570894 18792 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:36947
I20260806 16:58:04.570971 18926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:36947 every 8 connection(s)
I20260806 16:58:04.571970 18792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:58:04.575875 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18792
I20260806 16:58:04.576092 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:58:04.576507 7780 external_mini_cluster.cc:1428] Setting key 1f296d727f99edde8393dbb5d7df59e3
Aug 06 16:58:04 dist-test-slave-cbsf krb5kdc[18681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035484, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:58:04.590389 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:04.574085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:40535 (local address 127.7.153.62:33639)
0806 16:58:04.574269 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:04.574274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:04.575273 (+ 999us) server_negotiation.cc:407] Connection header received
0806 16:58:04.577376 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:04.577380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:04.577450 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:04.577523 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:04.579387 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.580133 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.581626 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.582027 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.582140 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:04.585892 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:04.585899 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:04.585905 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:04.585946 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:04.587834 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:04.588482 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:04.588487 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:04.588489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:04.588608 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:04.589069 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:04.589075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:04.589079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:04.589368 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:04.589510 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:04.590117 (+ 607us) server_negotiation.cc:299] Negotiation successful
0806 16:58:04.590247 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 16:58:04.591315 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:04.574509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33639 (local address 127.7.153.1:40535)
0806 16:58:04.575095 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:04.575145 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:04.577036 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:04.577769 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:04.577780 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:04.578374 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:04.579177 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:04.579204 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.580293 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.580300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:04.581473 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:04.581485 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.582237 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.582244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:04.582515 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:04.583237 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:04.583264 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:04.585631 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:04.587994 (+ 2363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:04.588000 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:04.588026 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:04.588328 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:04.588776 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:04.588778 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:04.588779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:04.588935 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:04.589493 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:04.589498 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:04.589848 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 16:58:04.590028 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 16:58:04.590327 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 16:58:04.592902 18927 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33639
I20260806 16:58:04.593194 18927 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:04.593843 18927 heartbeater.cc:511] Master 127.7.153.62:33639 requested a full tablet report, sending...
I20260806 16:58:04.595683 18728 ts_manager.cc:194] Registered new tserver with Master: a0bde47bd7e74c4189c905ce6f325d38 (127.7.153.1:36947)
I20260806 16:58:04.597026 18728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:40535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:58:04.611658 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33639
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:58:04.736363 18932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:04.736794 18932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:04.736912 18932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:04.741253 18932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:04.741374 18932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:04.741479 18932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:58:04.747325 18932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:04.748610 18932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:04.749773 18932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:04.760428 18937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:04.760586 18932 server_base.cc:1034] running on GCE node
W20260806 16:58:04.760457 18938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.760797 18940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:04.761227 18932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:04.761955 18932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:04.763123 18932 hybrid_clock.cc:648] HybridClock initialized: now 1786035484763110 us; error 29 us; skew 500 ppm
Aug 06 16:58:04 dist-test-slave-cbsf krb5kdc[18681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035484, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:04.766148 18932 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:58:04.767166 18932 webserver.cc:460] Webserver started at http://127.7.153.2:36585/ using document root <none> and password file <none>
I20260806 16:58:04.767813 18932 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:04.767915 18932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:04.768175 18932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:04.770617 18932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "b82d358120d549779bce20609123832b"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "3738396081ed689849a8d8e58df29aba"
server_key_iv: "691f5742674a5b730d6b0a6cc012e505"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.771245 18932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "b82d358120d549779bce20609123832b"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "3738396081ed689849a8d8e58df29aba"
server_key_iv: "691f5742674a5b730d6b0a6cc012e505"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.775628 18932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 16:58:04.778522 18947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.779922 18932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 16:58:04.780071 18932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "b82d358120d549779bce20609123832b"
format_stamp: "Formatted at 2026-08-06 16:58:04 on dist-test-slave-cbsf"
server_key: "3738396081ed689849a8d8e58df29aba"
server_key_iv: "691f5742674a5b730d6b0a6cc012e505"
server_key_version: "encryptionkey@0"
I20260806 16:58:04.780207 18932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:04.794672 18932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:04.798178 18932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:04.798355 18932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:04.798962 18932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:04.799846 18932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:04.799896 18932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.799938 18932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:04.799954 18932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:04.809512 18932 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:38485
I20260806 16:58:04.809509 19066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:38485 every 8 connection(s)
I20260806 16:58:04.810652 18932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:58:04.820688 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 18932
I20260806 16:58:04.820873 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:58:04.821252 7780 external_mini_cluster.cc:1428] Setting key 1d12134aabc742b26382f2cfa7d8b090
Aug 06 16:58:04 dist-test-slave-cbsf krb5kdc[18681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035484, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:04.826632 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:04.812675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:58867 (local address 127.7.153.62:33639)
0806 16:58:04.812915 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:04.812919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:04.813818 (+ 899us) server_negotiation.cc:407] Connection header received
0806 16:58:04.815387 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:04.815390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:04.815443 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:04.815551 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:04.816879 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.817442 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.818698 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.818939 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.819030 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:04.822319 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:04.822323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:04.822325 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:04.822352 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:04.823903 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:04.824537 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:04.824545 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:04.824546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:04.824631 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:04.825203 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:04.825207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:04.825208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:04.825464 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:04.825551 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:04.826353 (+ 802us) server_negotiation.cc:299] Negotiation successful
0806 16:58:04.826479 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 16:58:04.827941 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:04.813112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33639 (local address 127.7.153.2:58867)
0806 16:58:04.813652 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:04.813700 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:04.815170 (+ 1470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:04.815744 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:04.815752 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:04.816147 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:04.816719 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:04.816735 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.817601 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.817603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:04.818538 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:04.818548 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:04.819113 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:04.819115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:04.819266 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:04.820067 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:04.820094 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:04.822105 (+ 2011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:04.824056 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:04.824064 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:04.824087 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:04.824410 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:04.824781 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:04.824787 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:04.824791 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:04.825053 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:04.825587 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:04.825598 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:04.826016 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 16:58:04.826278 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 16:58:04.826722 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":109,"threads_started":1}
I20260806 16:58:04.829520 19067 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33639
I20260806 16:58:04.829802 19067 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:04.830364 19067 heartbeater.cc:511] Master 127.7.153.62:33639 requested a full tablet report, sending...
I20260806 16:58:04.831554 18728 ts_manager.cc:194] Registered new tserver with Master: b82d358120d549779bce20609123832b (127.7.153.2:38485)
I20260806 16:58:04.832178 18728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:58867
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:58:04.852150 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33639
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:58:04.972970 19072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:04.973271 19072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:04.973318 19072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:04.977975 19072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:04.978060 19072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:04.978164 19072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:58:04.983933 19072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:33639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:04.985297 19072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:04.986410 19072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:04.999593 19078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.999517 19081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:04.999517 19079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:05.000200 19072 server_base.cc:1034] running on GCE node
I20260806 16:58:05.000772 19072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:05.001509 19072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:05.002830 19072 hybrid_clock.cc:648] HybridClock initialized: now 1786035485002792 us; error 33 us; skew 500 ppm
Aug 06 16:58:05 dist-test-slave-cbsf krb5kdc[18681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035485, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:05.006556 19072 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:58:05.007705 19072 webserver.cc:460] Webserver started at http://127.7.153.3:44593/ using document root <none> and password file <none>
I20260806 16:58:05.008339 19072 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:05.008440 19072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:05.008755 19072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:58:05.011004 19072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "b8207b5bece44cd299bfe81f653666a4"
format_stamp: "Formatted at 2026-08-06 16:58:05 on dist-test-slave-cbsf"
server_key: "d0c4629822be7ab8cc14e03248b200ba"
server_key_iv: "2c9f27e0ac5cc1906ea81b761b0da899"
server_key_version: "encryptionkey@0"
I20260806 16:58:05.011626 19072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "b8207b5bece44cd299bfe81f653666a4"
format_stamp: "Formatted at 2026-08-06 16:58:05 on dist-test-slave-cbsf"
server_key: "d0c4629822be7ab8cc14e03248b200ba"
server_key_iv: "2c9f27e0ac5cc1906ea81b761b0da899"
server_key_version: "encryptionkey@0"
I20260806 16:58:05.015969 19072 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 16:58:05.018922 19088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:05.021142 19072 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 16:58:05.021407 19072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "b8207b5bece44cd299bfe81f653666a4"
format_stamp: "Formatted at 2026-08-06 16:58:05 on dist-test-slave-cbsf"
server_key: "d0c4629822be7ab8cc14e03248b200ba"
server_key_iv: "2c9f27e0ac5cc1906ea81b761b0da899"
server_key_version: "encryptionkey@0"
I20260806 16:58:05.021566 19072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:05.046941 19072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:05.050315 19072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:05.050499 19072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:05.051091 19072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:05.052011 19072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:05.052058 19072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:05.052134 19072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:05.052181 19072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:05.062567 19072 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:46245
I20260806 16:58:05.062623 19203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:46245 every 8 connection(s)
I20260806 16:58:05.063637 19072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:58:05.071599 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 19072
I20260806 16:58:05.071790 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:58:05.072110 7780 external_mini_cluster.cc:1428] Setting key faee48b208945092e63eca1862982a90
Aug 06 16:58:05 dist-test-slave-cbsf krb5kdc[18681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035485, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:05.079376 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.065762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:53985 (local address 127.7.153.62:33639)
0806 16:58:05.065933 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.065937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.066814 (+ 877us) server_negotiation.cc:407] Connection header received
0806 16:58:05.068310 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.068314 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.068385 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.068506 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:05.069858 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.070446 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.071820 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.072100 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.072245 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.075379 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:05.075382 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:05.075384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:05.075409 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:05.077045 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:05.077700 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:05.077704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:05.077707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:05.077794 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:05.078165 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:05.078169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:05.078171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:05.078381 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:05.078503 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.079070 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.079204 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 16:58:05.080288 19206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.066143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:33639 (local address 127.7.153.3:53985)
0806 16:58:05.066642 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.066687 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:05.068060 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:05.068728 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:05.068736 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:05.069142 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:05.069675 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.069691 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.070603 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.070609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.071590 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.071601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.072320 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.072325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.072546 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.073309 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:05.073328 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:05.075140 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:05.077195 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:05.077203 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:05.077224 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:05.077576 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:05.077891 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:05.077895 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:05.077897 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:05.078063 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:05.078494 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:05.078502 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:05.078800 (+ 298us) client_negotiation.cc:769] Sending connection context
0806 16:58:05.079026 (+ 226us) client_negotiation.cc:240] Negotiation successful
0806 16:58:05.079398 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":124,"threads_started":1}
I20260806 16:58:05.081693 19204 heartbeater.cc:347] Connected to a master server at 127.7.153.62:33639
I20260806 16:58:05.082010 19204 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:05.082620 19204 heartbeater.cc:511] Master 127.7.153.62:33639 requested a full tablet report, sending...
I20260806 16:58:05.083918 18728 ts_manager.cc:194] Registered new tserver with Master: b8207b5bece44cd299bfe81f653666a4 (127.7.153.3:46245)
I20260806 16:58:05.084558 18728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:53985
I20260806 16:58:05.086782 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:58:05.097465 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.088852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.7.153.62:33639)
0806 16:58:05.089020 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.089025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.089208 (+ 183us) server_negotiation.cc:407] Connection header received
0806 16:58:05.089266 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.089268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.089318 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.089401 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:05.090189 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.090759 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.091712 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.091950 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.092044 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.093816 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:05.093819 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:05.093821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:05.093849 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:05.095318 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:05.095797 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:05.095800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:05.095801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:05.095886 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:05.096213 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:05.096216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:05.096217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:05.096526 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:05.096657 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.097025 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.097180 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 16:58:05.102519 18728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:58:05.105810 18728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:58:05.122726 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.116000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:38485 (local address 127.0.0.1:59044)
0806 16:58:05.117099 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.117112 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:05.117276 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:05.117832 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:05.117838 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:05.117863 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:05.118039 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.118050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.119440 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.119444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.121011 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.121023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.122097 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.122101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.122229 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.122277 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 16:58:05.122378 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 16:58:05.122538 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1045,"mutex_wait_us":49,"spinlock_wait_cycles":8192,"thread_start_us":142,"threads_started":1}
I20260806 16:58:05.122886 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.115994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41162 (local address 127.7.153.1:36947)
0806 16:58:05.116991 (+ 997us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.116998 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.117587 (+ 589us) server_negotiation.cc:407] Connection header received
0806 16:58:05.117754 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.117782 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.117965 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.118129 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:05.118771 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.119861 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.121066 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.121948 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.122071 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.122242 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.122625 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.122737 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":887,"thread_start_us":82,"threads_started":1}
I20260806 16:58:05.123296 19217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.115842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:36947 (local address 127.0.0.1:41162)
0806 16:58:05.117490 (+ 1648us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.117501 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:05.117605 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:05.118243 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:05.118249 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:05.118284 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:05.118574 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.118583 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.119981 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.119985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.120935 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.120945 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.122304 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.122307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.122433 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.122479 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 16:58:05.123079 (+ 600us) client_negotiation.cc:240] Negotiation successful
0806 16:58:05.123166 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1596,"mutex_wait_us":896,"thread_start_us":108,"threads_started":1}
I20260806 16:58:05.123445 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.116479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55330 (local address 127.7.153.3:46245)
0806 16:58:05.116959 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.116971 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.117249 (+ 278us) server_negotiation.cc:407] Connection header received
0806 16:58:05.117439 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.117444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.117666 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.117838 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:05.118662 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.119741 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.121342 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.121942 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.122084 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.122241 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.123161 (+ 920us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.123280 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":154,"threads_started":1}
I20260806 16:58:05.123477 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.116744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59044 (local address 127.7.153.2:38485)
0806 16:58:05.117303 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.117315 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.117338 (+ 23us) server_negotiation.cc:407] Connection header received
0806 16:58:05.117438 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.117444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.117666 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.117838 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:05.118189 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.119287 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.121146 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.121948 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.122968 (+ 1020us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.123152 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.123206 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.123303 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":109,"threads_started":1}
I20260806 16:58:05.124508 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.115842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46245 (local address 127.0.0.1:55330)
0806 16:58:05.117031 (+ 1189us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.117090 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:05.117276 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:05.118025 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:05.118028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:05.118077 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:05.118493 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.118518 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.119897 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.119903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.121224 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.121232 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.122092 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.122096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.122495 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.122528 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 16:58:05.122599 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 16:58:05.124362 (+ 1763us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":994,"mutex_wait_us":106,"spinlock_wait_cycles":5888,"thread_start_us":89,"threads_started":1}
I20260806 16:58:05.126715 18999 tablet_service.cc:1467] Processing CreateTablet for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb (DEFAULT_TABLE table=test-table [id=fd3387b1c2ff4cb4851f745b1f296444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:58:05.126765 18856 tablet_service.cc:1467] Processing CreateTablet for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb (DEFAULT_TABLE table=test-table [id=fd3387b1c2ff4cb4851f745b1f296444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:58:05.127938 18999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:05.127985 18856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:05.127931 19136 tablet_service.cc:1467] Processing CreateTablet for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb (DEFAULT_TABLE table=test-table [id=fd3387b1c2ff4cb4851f745b1f296444]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:58:05.129194 19136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:05.135651 19223 tablet_bootstrap.cc:492] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Bootstrap starting.
I20260806 16:58:05.136878 19225 tablet_bootstrap.cc:492] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: Bootstrap starting.
I20260806 16:58:05.137598 19226 tablet_bootstrap.cc:492] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Bootstrap starting.
I20260806 16:58:05.139964 19223 tablet_bootstrap.cc:654] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:05.140319 19225 tablet_bootstrap.cc:654] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:05.141047 19223 log.cc:824] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:05.141111 19225 log.cc:824] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:05.141348 19226 tablet_bootstrap.cc:654] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:05.142123 19226 log.cc:824] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:05.143535 19225 tablet_bootstrap.cc:492] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: No bootstrap required, opened a new log
I20260806 16:58:05.143770 19225 ts_tablet_manager.cc:1397] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 16:58:05.144209 19226 tablet_bootstrap.cc:492] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: No bootstrap required, opened a new log
I20260806 16:58:05.144407 19226 ts_tablet_manager.cc:1397] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 16:58:05.148676 19226 raft_consensus.cc:348] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.148676 19225 raft_consensus.cc:348] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.149044 19225 raft_consensus.cc:374] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:05.149044 19226 raft_consensus.cc:374] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:05.149108 19226 raft_consensus.cc:729] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8207b5bece44cd299bfe81f653666a4, State: Initialized, Role: FOLLOWER
I20260806 16:58:05.149119 19225 raft_consensus.cc:729] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0bde47bd7e74c4189c905ce6f325d38, State: Initialized, Role: FOLLOWER
I20260806 16:58:05.149631 19226 consensus_queue.cc:260] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.149631 19225 consensus_queue.cc:260] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.150539 19223 tablet_bootstrap.cc:492] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: No bootstrap required, opened a new log
I20260806 16:58:05.150777 19225 ts_tablet_manager.cc:1428] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 16:58:05.150777 19226 ts_tablet_manager.cc:1428] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260806 16:58:05.150806 19223 ts_tablet_manager.cc:1397] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260806 16:58:05.150799 18927 heartbeater.cc:503] Master 127.7.153.62:33639 was elected leader, sending a full tablet report...
I20260806 16:58:05.151206 19204 heartbeater.cc:503] Master 127.7.153.62:33639 was elected leader, sending a full tablet report...
I20260806 16:58:05.154736 19223 raft_consensus.cc:348] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.155100 19223 raft_consensus.cc:374] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:05.155166 19223 raft_consensus.cc:729] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82d358120d549779bce20609123832b, State: Initialized, Role: FOLLOWER
I20260806 16:58:05.155668 19223 consensus_queue.cc:260] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.156468 19067 heartbeater.cc:503] Master 127.7.153.62:33639 was elected leader, sending a full tablet report...
I20260806 16:58:05.156976 19223 ts_tablet_manager.cc:1428] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260806 16:58:05.183048 19233 raft_consensus.cc:482] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:58:05.183277 19233 raft_consensus.cc:504] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.184731 19233 leader_election.cc:288] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0bde47bd7e74c4189c905ce6f325d38 (127.7.153.1:36947), b8207b5bece44cd299bfe81f653666a4 (127.7.153.3:46245)
I20260806 16:58:05.189216 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.185238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:33067 (local address 127.7.153.3:46245)
0806 16:58:05.185353 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.185358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.185373 (+ 15us) server_negotiation.cc:407] Connection header received
0806 16:58:05.185454 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.185457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.185509 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.185595 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:05.185914 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.186620 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.187973 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.188630 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.188781 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.188850 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.189047 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.189111 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 16:58:05.189244 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.185004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46245 (local address 127.7.153.2:33067)
0806 16:58:05.185242 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.185259 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:05.185361 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:05.185617 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:05.185620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:05.185641 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:05.185762 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.185768 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.186725 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.186729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.187823 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.187833 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.188773 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.188780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.188900 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.188927 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:58:05.189011 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 16:58:05.189087 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":19}
I20260806 16:58:05.189879 19234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.185016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:36947 (local address 127.7.153.2:60233)
0806 16:58:05.185842 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.185859 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:05.185964 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:05.186281 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:05.186284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:05.186302 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:05.186412 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.186418 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.187379 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.187382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.188422 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:05.188433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.189477 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.189480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:05.189599 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.189623 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 16:58:05.189702 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 16:58:05.189775 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":359,"thread_start_us":147,"threads_started":1}
I20260806 16:58:05.189940 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.185191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:60233 (local address 127.7.153.1:36947)
0806 16:58:05.185323 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.185328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.185949 (+ 621us) server_negotiation.cc:407] Connection header received
0806 16:58:05.186120 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.186123 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.186179 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.186241 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:05.186519 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.187244 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.188550 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.189192 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.189306 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.189375 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.189741 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.189830 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 16:58:05.190071 19157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da9bc353b454f6ea6cc63db0a4cf3eb" candidate_uuid: "b82d358120d549779bce20609123832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8207b5bece44cd299bfe81f653666a4" is_pre_election: true
I20260806 16:58:05.190460 19157 raft_consensus.cc:2454] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82d358120d549779bce20609123832b in term 0.
I20260806 16:58:05.190500 18877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da9bc353b454f6ea6cc63db0a4cf3eb" candidate_uuid: "b82d358120d549779bce20609123832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0bde47bd7e74c4189c905ce6f325d38" is_pre_election: true
I20260806 16:58:05.190742 18877 raft_consensus.cc:2454] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82d358120d549779bce20609123832b in term 0.
I20260806 16:58:05.190979 18950 leader_election.cc:302] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8207b5bece44cd299bfe81f653666a4, b82d358120d549779bce20609123832b; no voters:
I20260806 16:58:05.191318 19233 raft_consensus.cc:2781] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:58:05.191406 19233 raft_consensus.cc:482] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:58:05.191450 19233 raft_consensus.cc:3037] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:05.192535 19233 raft_consensus.cc:504] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.192911 19233 leader_election.cc:288] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [CANDIDATE]: Term 1 election: Requested vote from peers a0bde47bd7e74c4189c905ce6f325d38 (127.7.153.1:36947), b8207b5bece44cd299bfe81f653666a4 (127.7.153.3:46245)
I20260806 16:58:05.193282 18877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da9bc353b454f6ea6cc63db0a4cf3eb" candidate_uuid: "b82d358120d549779bce20609123832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0bde47bd7e74c4189c905ce6f325d38"
I20260806 16:58:05.193347 19157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da9bc353b454f6ea6cc63db0a4cf3eb" candidate_uuid: "b82d358120d549779bce20609123832b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8207b5bece44cd299bfe81f653666a4"
I20260806 16:58:05.193441 18877 raft_consensus.cc:3037] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:05.193506 19157 raft_consensus.cc:3037] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:05.194571 18877 raft_consensus.cc:2454] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82d358120d549779bce20609123832b in term 1.
I20260806 16:58:05.194844 19157 raft_consensus.cc:2454] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82d358120d549779bce20609123832b in term 1.
I20260806 16:58:05.194948 18951 leader_election.cc:302] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0bde47bd7e74c4189c905ce6f325d38, b82d358120d549779bce20609123832b; no voters:
I20260806 16:58:05.195160 19233 raft_consensus.cc:2781] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:58:05.195436 19233 raft_consensus.cc:686] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 1 LEADER]: Becoming Leader. State: Replica: b82d358120d549779bce20609123832b, State: Running, Role: LEADER
I20260806 16:58:05.195845 19233 consensus_queue.cc:237] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } }
I20260806 16:58:05.199558 18727 catalog_manager.cc:5495] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b reported cstate change: term changed from 0 to 1, leader changed from <none> to b82d358120d549779bce20609123832b (127.7.153.2). New cstate: current_term: 1 leader_uuid: "b82d358120d549779bce20609123832b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b82d358120d549779bce20609123832b" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38485 } health_report { overall_health: HEALTHY } } }
I20260806 16:58:05.232106 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.228033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59050 (local address 127.7.153.2:38485)
0806 16:58:05.228209 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:05.228213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:05.228231 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:58:05.228432 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:05.228434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:05.228499 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:05.228616 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:58:05.228979 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.229505 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.230456 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:05.230683 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:05.230768 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:05.231146 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:58:05.231642 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:58:05.231738 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:05.231918 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 16:58:05.231983 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 16:58:05.239382 18877 raft_consensus.cc:1261] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 1 FOLLOWER]: Refusing update from remote peer b82d358120d549779bce20609123832b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:58:05.239387 19157 raft_consensus.cc:1261] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 1 FOLLOWER]: Refusing update from remote peer b82d358120d549779bce20609123832b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:58:05.240275 19235 consensus_queue.cc:1035] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0bde47bd7e74c4189c905ce6f325d38" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 36947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:58:05.240527 19233 consensus_queue.cc:1035] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8207b5bece44cd299bfe81f653666a4" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:58:05.249740 19238 mvcc.cc:205] Tried to move back new op lower bound from 7315601347530604544 to 7315601347365302272. Current Snapshot: MvccSnapshot[applied={T|T < 7315601347530604544}]
I20260806 16:58:05.250046 19239 mvcc.cc:205] Tried to move back new op lower bound from 7315601347530604544 to 7315601347365302272. Current Snapshot: MvccSnapshot[applied={T|T < 7315601347530604544}]
I20260806 16:58:05.250720 19240 mvcc.cc:205] Tried to move back new op lower bound from 7315601347530604544 to 7315601347365302272. Current Snapshot: MvccSnapshot[applied={T|T < 7315601347530604544}]
I20260806 16:58:05.261878 18727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:58:05.262096 18727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:58:05.264842 18727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e632c186cfb44426b222f2905fb9a3b2: Sending DeleteTablet for 3 replicas of tablet 6da9bc353b454f6ea6cc63db0a4cf3eb
I20260806 16:58:05.265869 18999 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:58:05 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:59044
I20260806 16:58:05.265869 19136 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:58:05 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:55330
I20260806 16:58:05.265909 18856 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:58:05 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:41162
I20260806 16:58:05.266491 19250 tablet_replica.cc:330] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38: stopping tablet replica
I20260806 16:58:05.266889 19250 raft_consensus.cc:2229] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:58:05.266987 19249 tablet_replica.cc:330] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: stopping tablet replica
I20260806 16:58:05.267288 19249 raft_consensus.cc:2229] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 1 LEADER]: Raft consensus shutting down.
I20260806 16:58:05.267300 19250 raft_consensus.cc:2258] T 6da9bc353b454f6ea6cc63db0a4cf3eb P a0bde47bd7e74c4189c905ce6f325d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:58:05.267750 19249 raft_consensus.cc:2258] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:58:05.267766 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18792
I20260806 16:58:05.271521 19251 tablet_replica.cc:330] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: stopping tablet replica
I20260806 16:58:05.272284 19251 raft_consensus.cc:2229] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:58:05.272682 19251 raft_consensus.cc:2258] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:58:05.274744 19251 ts_tablet_manager.cc:1905] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:58:05.274721 19249 ts_tablet_manager.cc:1905] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:58:05.278136 19251 ts_tablet_manager.cc:1918] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:58:05.278280 19251 log.cc:1196] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/6da9bc353b454f6ea6cc63db0a4cf3eb
I20260806 16:58:05.278599 19249 ts_tablet_manager.cc:1918] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:58:05.278662 19251 ts_tablet_manager.cc:1939] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b8207b5bece44cd299bfe81f653666a4: Deleting consensus metadata
I20260806 16:58:05.278838 19249 log.cc:1196] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/6da9bc353b454f6ea6cc63db0a4cf3eb
I20260806 16:58:05.279253 19249 ts_tablet_manager.cc:1939] T 6da9bc353b454f6ea6cc63db0a4cf3eb P b82d358120d549779bce20609123832b: Deleting consensus metadata
W20260806 16:58:05.279695 18715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:36947 (error 108)
I20260806 16:58:05.280259 18714 catalog_manager.cc:4841] TS b8207b5bece44cd299bfe81f653666a4 (127.7.153.3:46245): tablet 6da9bc353b454f6ea6cc63db0a4cf3eb (table test-table [id=fd3387b1c2ff4cb4851f745b1f296444]) successfully deleted
I20260806 16:58:05.280498 18712 catalog_manager.cc:4841] TS b82d358120d549779bce20609123832b (127.7.153.2:38485): tablet 6da9bc353b454f6ea6cc63db0a4cf3eb (table test-table [id=fd3387b1c2ff4cb4851f745b1f296444]) successfully deleted
I20260806 16:58:05.280921 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18932
I20260806 16:58:05.282426 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:05.281131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:36947 (local address 127.0.0.1:41168)
0806 16:58:05.282224 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:05.282314 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:36947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":952}
W20260806 16:58:05.283047 18715 catalog_manager.cc:4584] TS a0bde47bd7e74c4189c905ce6f325d38 (127.7.153.1:36947): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6da9bc353b454f6ea6cc63db0a4cf3eb: Network error: Client connection negotiation failed: client connection to 127.7.153.1:36947: connect: Connection refused (error 111)
I20260806 16:58:05.290094 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 19072
I20260806 16:58:05.298009 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 18696
2026-08-06T16:58:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2530 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:58:05 dist-test-slave-cbsf krb5kdc[19256](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:58:05 dist-test-slave-cbsf krb5kdc[19256](info): set up 2 sockets
Aug 06 16:58:05 dist-test-slave-cbsf krb5kdc[19256](info): commencing operation
krb5kdc: starting...
W20260806 16:58:06.397059 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:58:06 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:58:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:58:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/rangeradmin_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/rangeradmin_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/rangerlookup_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/rangerlookup_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
I20260806 16:58:06.594202 7780 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskOJ6ny6/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/postgres -l logfile start
2026-08-06 16:58:09.301 UTC [19288] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 16:58:09.301 UTC [19288] LOG: listening on IPv4 address "127.7.153.20", port 59189
2026-08-06 16:58:09.305 UTC [19288] LOG: listening on Unix socket "/tmp/.s.PGSQL.59189"
2026-08-06 16:58:09.327 UTC [19291] LOG: database system was shut down at 2026-08-06 16:58:07 UTC
2026-08-06 16:58:09.331 UTC [19288] LOG: database system is ready to accept connections
I20260806 16:58:10.326386 7780 mini_postgres.cc:96] Postgres bound to 59189
2026-08-06 16:58:10.337 UTC [19299] FATAL: database "slave" does not exist
127.7.153.20:59189 - accepting connections
I20260806 16:58:10.338256 7780 mini_ranger.cc:161] Starting Ranger...
I20260806 16:58:10.357986 7780 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 16:58:10.888630 7780 mini_ranger.cc:87] Created ranger Postgres database
I20260806 16:58:10.888782 7780 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-admin
2026-08-06 16:58:11,286 [I] DB FLAVOR :POSTGRES
2026-08-06 16:58:11,287 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 16:58:11,287 [I] Checking connection..
2026-08-06 16:58:11,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 16:58:11,585 [I] Checking connection passed.
2026-08-06 16:58:11,585 [I] --------- Verifying version history table ---------
2026-08-06 16:58:11,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 16:58:11,844 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 16:58:11,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 16:58:12,117 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 16:58:12,118 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 16:58:12,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 16:58:12.360 UTC [19369] WARNING: there is no transaction in progress
2026-08-06 16:58:12,368 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 16:58:12,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 16:58:12,634 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 16:58:12,634 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 16:58:12,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 16:58:12,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 16:58:13,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-cbsf.c.gcp-upstream.internal','N') ;"
2026-08-06 16:58:13,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 16:58:13,732 [I] Table x_portal_user does not exist in database ranger
2026-08-06 16:58:13,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 16:58:14,016 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 16:58:14,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 16:58:14,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 16:58:14,548 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 16:58:14,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 16:58:15.653 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.673 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.692 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.711 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.729 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.749 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.815 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.823 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.841 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.852 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.865 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.880 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.892 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.899 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.908 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:15.916 UTC [19479] WARNING: there is no transaction in progress
2026-08-06 16:58:16,681 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 16:58:16,682 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 16:58:16,956 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 16:58:16,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 16:58:17,220 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 16:58:17,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 16:58:17,496 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 16:58:17,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 16:58:17,749 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 16:58:18,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-cbsf.c.gcp-upstream.internal';"
2026-08-06 16:58:18,303 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 16:58:18,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 16:58:18,587 [I] DB_PATCHES have already been applied
I20260806 16:58:18.593050 7780 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-admin:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskOJ6ny6/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 16:58:18.593164 7780 mini_ranger.cc:193] Using host: 127.7.153.20
I20260806 16:58:18.598133 7780 mini_ranger.cc:227] Ranger admin URL: http://127.7.153.20:54561
Aug 06, 2026 4:58:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:58:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:58:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 4:58:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 4:58:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 4:58:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 4:58:19 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 16:58:19.806356 7780 mini_ranger.cc:160] Time spent starting Ranger: real 9.468s user 0.002s sys 0.012s
Aug 06, 2026 4:58:41 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 4:58:41 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 4:58:41 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 4:58:41 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 4:58:42 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 16:58:43.448068 7780 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/rangerkms_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/rangerkms_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.153.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.153.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 16:58:43 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035523, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 16:58:43.548100 7780 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 16:58:43.560751 7780 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 16:58:44.553751 7780 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 16:58:44.553872 7780 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms
I20260806 16:58:44.553995 7780 mini_ranger_kms.cc:227] Using postgres at 127.7.153.20:59189
2026-08-06 16:58:45,039 [I] DB FLAVOR :POSTGRES
2026-08-06 16:58:45,040 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 16:58:45,040 [I] Checking connection
2026-08-06 16:58:45,040 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 16:58:45,407 [I] connection success
2026-08-06 16:58:45,408 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 16:58:45,408 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 16:58:45,408 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 16:58:45,747 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 16:58:45,748 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 16:58:45,748 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 16:58:45,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:59189/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 16:58:46,131 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 16:58:46.626482 7780 mini_ranger_kms.cc:310] Created kms service
I20260806 16:58:46.822702 7780 mini_ranger_kms.cc:326] Created kudu user
I20260806 16:58:46.887892 7780 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 16:58:46 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035523, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:58:47.398205 7780 mini_ranger_kms.cc:384] Added ranger policy
I20260806 16:58:47.398379 7780 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms:/tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 16:58:47.398402 7780 mini_ranger_kms.cc:240] Using host: 127.7.153.20
I20260806 16:58:47.405061 7780 mini_ranger_kms.cc:276] Ranger KMS PID: 19668
I20260806 16:58:47.405274 7780 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.153.20:47135
Aug 06, 2026 4:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 4:58:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 4:58:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 4:58:49 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 16:58:49.768491 7780 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.220s user 0.020s sys 0.359s
I20260806 16:58:49.768640 7780 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 16:58:49.768800 7780 mini_ranger_kms.cc:401] 127.7.153.20:47135/kms/v1/keys
Aug 06 16:58:49 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786035529, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.153.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 16:58:50 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035529, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.153.20@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
Aug 06 16:58:50 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035529, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.153.20@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
Aug 06 16:58:53 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:58:53.394498 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:39139
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:39139
--ranger_config_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:47135/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:58:53.550621 19721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:53.550940 19721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:53.550984 19721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:53.555567 19721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:58:53.555655 19721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:53.555675 19721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:53.555691 19721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:58:53.555707 19721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:58:53.561945 19721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.153.20:47135/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:39139
--ranger_config_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:39139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:53.563225 19721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:53.564508 19721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:53.574810 19729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:53.574800 19731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:53.574800 19728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:53.575708 19721 server_base.cc:1034] running on GCE node
I20260806 16:58:53.576450 19721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:53.577852 19721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:53.579090 19721 hybrid_clock.cc:648] HybridClock initialized: now 1786035533579063 us; error 48 us; skew 500 ppm
Aug 06 16:58:53 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035533, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:53.589334 19721 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:58:53.590590 19721 webserver.cc:460] Webserver started at http://127.7.153.62:43505/ using document root <none> and password file <none>
I20260806 16:58:53.591233 19721 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:53.591298 19721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:53.591536 19721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:58:53 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035533, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:58:53.663633 19721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "59381a6349ae4a4c92e21a49ad37b0cd"
format_stamp: "Formatted at 2026-08-06 16:58:53 on dist-test-slave-cbsf"
server_key: "373b13d137e8d7e14f4dd58606def72c"
server_key_iv: "b785507d3e1fbb2cae84aacd425b154f"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:53.664530 19721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "59381a6349ae4a4c92e21a49ad37b0cd"
format_stamp: "Formatted at 2026-08-06 16:58:53 on dist-test-slave-cbsf"
server_key: "373b13d137e8d7e14f4dd58606def72c"
server_key_iv: "b785507d3e1fbb2cae84aacd425b154f"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:53.669402 19721 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 16:58:53.688964 19739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:53.690605 19721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 16:58:53.690783 19721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "59381a6349ae4a4c92e21a49ad37b0cd"
format_stamp: "Formatted at 2026-08-06 16:58:53 on dist-test-slave-cbsf"
server_key: "373b13d137e8d7e14f4dd58606def72c"
server_key_iv: "b785507d3e1fbb2cae84aacd425b154f"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:53.690924 19721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:53.706796 19721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:53.710847 19721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:53.711104 19721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:53.721078 19721 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:39139
I20260806 16:58:53.721113 19793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:39139 every 8 connection(s)
I20260806 16:58:53.722383 19721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:58:53.725780 19794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:53.727206 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 19721
I20260806 16:58:53.727350 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:58:53.727690 7780 external_mini_cluster.cc:1428] Setting key 1d1139fb1dc2fdcb6567ffac2cf4dd06
I20260806 16:58:53.735754 19794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd: Bootstrap starting.
I20260806 16:58:53.739002 19794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd: Neither blocks nor log segments found. Creating new log.
Aug 06 16:58:53 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:53.739981 19794 log.cc:824] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:53.743391 19794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd: No bootstrap required, opened a new log
I20260806 16:58:53.748065 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:53.729260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.7.153.62:39139)
0806 16:58:53.729732 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:53.729754 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:53.729804 (+ 50us) server_negotiation.cc:407] Connection header received
0806 16:58:53.731061 (+ 1257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:53.731092 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:53.731621 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:53.732086 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:53.733052 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:53.734790 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:53.736106 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:53.737024 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:53.737242 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:53.740524 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:53.740534 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:53.740561 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:53.740595 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:53.743735 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:53.744333 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:53.744340 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:53.744347 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:53.744504 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:53.744859 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:53.744862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:53.744864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:53.745459 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:53.745700 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:53.746518 (+ 818us) server_negotiation.cc:299] Negotiation successful
0806 16:58:53.746866 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":168,"threads_started":1}
I20260806 16:58:53.748721 19794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39139 } }
I20260806 16:58:53.749020 19794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:53.749121 19794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59381a6349ae4a4c92e21a49ad37b0cd, State: Initialized, Role: FOLLOWER
I20260806 16:58:53.749727 19794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39139 } }
I20260806 16:58:53.749897 19794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:58:53.749992 19794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:58:53.750111 19794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:53.751495 19794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39139 } }
I20260806 16:58:53.751921 19794 leader_election.cc:302] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59381a6349ae4a4c92e21a49ad37b0cd; no voters:
I20260806 16:58:53.752334 19794 leader_election.cc:288] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:58:53.752456 19801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:58:53.752769 19801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [term 1 LEADER]: Becoming Leader. State: Replica: 59381a6349ae4a4c92e21a49ad37b0cd, State: Running, Role: LEADER
I20260806 16:58:53.753170 19801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39139 } }
I20260806 16:58:53.753890 19794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:58:53.756399 19802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39139 } } }
I20260806 16:58:53.756569 19802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:53.756831 19794 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 16:58:53.756831 19802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59381a6349ae4a4c92e21a49ad37b0cd. Latest consensus state: current_term: 1 leader_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59381a6349ae4a4c92e21a49ad37b0cd" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39139 } } }
I20260806 16:58:53.757077 19802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd [sys.catalog]: This master's current role is: LEADER
I20260806 16:58:53.758445 19815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:58:53.767998 19815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:58:53.779261 19815 catalog_manager.cc:1347] Generated new cluster ID: f4db0ec5cfe646a9aa9f5b373734b82b
I20260806 16:58:53.779363 19815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:58:53.800467 19815 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:58:53.802217 19815 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:58:53.814589 19815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd: Generated new TSK 0
I20260806 16:58:53.815881 19815 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:58:54.624927 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:47135/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:39139
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:58:54.807273 19842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:54.807652 19842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:54.807775 19842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:54.812381 19842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:54.812490 19842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:54.812602 19842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:58:54.818813 19842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.153.20:47135/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:39139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:54.820092 19842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:54.821375 19842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:54.833158 19852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:54.833009 19850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:54.833003 19849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:54.833920 19842 server_base.cc:1034] running on GCE node
I20260806 16:58:54.834442 19842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:54.835250 19842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:54.836651 19842 hybrid_clock.cc:648] HybridClock initialized: now 1786035534836623 us; error 40 us; skew 500 ppm
Aug 06 16:58:54 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035534, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:54.840030 19842 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:58:54.841300 19842 webserver.cc:460] Webserver started at http://127.7.153.1:36721/ using document root <none> and password file <none>
I20260806 16:58:54.841967 19842 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:54.842067 19842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:54.842337 19842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:58:54 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035534, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:58:54.861851 19842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "eadf395dba3a4dbb8c3bbacf81358cf0"
format_stamp: "Formatted at 2026-08-06 16:58:54 on dist-test-slave-cbsf"
server_key: "629b951579afdce85c7d1c8d706f6c30"
server_key_iv: "8e2bd8d53d6a9913eac88f6aca4995d5"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:54.862603 19842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "eadf395dba3a4dbb8c3bbacf81358cf0"
format_stamp: "Formatted at 2026-08-06 16:58:54 on dist-test-slave-cbsf"
server_key: "629b951579afdce85c7d1c8d706f6c30"
server_key_iv: "8e2bd8d53d6a9913eac88f6aca4995d5"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:54.874817 19842 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.006s sys 0.000s
I20260806 16:58:54.903860 19859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:54.909480 19842 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.003s sys 0.000s
I20260806 16:58:54.909758 19842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "eadf395dba3a4dbb8c3bbacf81358cf0"
format_stamp: "Formatted at 2026-08-06 16:58:54 on dist-test-slave-cbsf"
server_key: "629b951579afdce85c7d1c8d706f6c30"
server_key_iv: "8e2bd8d53d6a9913eac88f6aca4995d5"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:54.909977 19842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:54.931380 19842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:54.935696 19842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:54.936061 19842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:54.936925 19842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:54.938170 19842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:54.938268 19842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:54.938355 19842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:54.938405 19842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:54.953542 19842 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:44007
I20260806 16:58:54.955171 19842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:58:54.963301 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 19842
I20260806 16:58:54.963477 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:58:54.963847 7780 external_mini_cluster.cc:1428] Setting key 48b1bf3f5385f6c2765736a75a45461a
I20260806 16:58:54.966049 19980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:44007 every 8 connection(s)
Aug 06 16:58:54 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035534, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:54.991815 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:54.968912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:41919 (local address 127.7.153.62:39139)
0806 16:58:54.971349 (+ 2437us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:54.971355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:54.972753 (+ 1398us) server_negotiation.cc:407] Connection header received
0806 16:58:54.973810 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:54.973814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:54.973891 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:54.973990 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:54.975795 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:54.976668 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:54.978552 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:54.978921 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:54.979009 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:54.986666 (+ 7657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:54.986671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:54.986674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:54.986714 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:54.988786 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:54.989615 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:54.989619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:54.989621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:54.989724 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:54.990198 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:54.990202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:54.990203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:54.990458 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:54.990535 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:54.991401 (+ 866us) server_negotiation.cc:299] Negotiation successful
0806 16:58:54.991574 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2338,"thread_start_us":125,"threads_started":1}
I20260806 16:58:54.995175 19985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:54.969568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:39139 (local address 127.7.153.1:41919)
0806 16:58:54.971745 (+ 2177us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:54.971827 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:54.973347 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:54.974378 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:54.974390 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:54.974809 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:54.975594 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:54.975617 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:54.976881 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:54.976884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:54.978389 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:54.978404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:54.979278 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:54.979282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:54.979532 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:54.984260 (+ 4728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:54.984289 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:54.986361 (+ 2072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:54.988992 (+ 2631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:54.989000 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:54.989024 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:54.989470 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:54.989853 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:54.989856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:54.989857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:54.990062 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:54.990625 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:54.990633 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:54.991038 (+ 405us) client_negotiation.cc:769] Sending connection context
0806 16:58:54.992131 (+ 1093us) client_negotiation.cc:240] Negotiation successful
0806 16:58:54.992608 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1830,"thread_start_us":155,"threads_started":1}
I20260806 16:58:54.997738 19981 heartbeater.cc:347] Connected to a master server at 127.7.153.62:39139
I20260806 16:58:54.998024 19981 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:54.998685 19981 heartbeater.cc:511] Master 127.7.153.62:39139 requested a full tablet report, sending...
I20260806 16:58:55.000825 19758 ts_manager.cc:194] Registered new tserver with Master: eadf395dba3a4dbb8c3bbacf81358cf0 (127.7.153.1:44007)
I20260806 16:58:55.002471 19758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:41919
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:58:55.045903 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:47135/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:39139
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 16:58:55.240645 19987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:55.241261 19987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:55.241410 19987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:55.248116 19987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:55.248314 19987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:55.248472 19987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:58:55.257047 19987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.153.20:47135/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:39139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:55.258845 19987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:55.260453 19987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:55.275588 19994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:55.276281 19993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:55.276633 19996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:55.282490 19987 server_base.cc:1034] running on GCE node
I20260806 16:58:55.283371 19987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:55.284303 19987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:55.288793 19987 hybrid_clock.cc:648] HybridClock initialized: now 1786035535288685 us; error 103 us; skew 500 ppm
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:55.294261 19987 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:58:55.295922 19987 webserver.cc:460] Webserver started at http://127.7.153.2:44953/ using document root <none> and password file <none>
I20260806 16:58:55.297005 19987 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:55.297212 19987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:55.297539 19987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:58:55.315515 19987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "9029bfacc4bf45a6b0089db178537094"
format_stamp: "Formatted at 2026-08-06 16:58:55 on dist-test-slave-cbsf"
server_key: "b272641a4eacd92a43102645626b3659"
server_key_iv: "0350237080f9a89018c9326043982c8e"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:55.321349 19987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "9029bfacc4bf45a6b0089db178537094"
format_stamp: "Formatted at 2026-08-06 16:58:55 on dist-test-slave-cbsf"
server_key: "b272641a4eacd92a43102645626b3659"
server_key_iv: "0350237080f9a89018c9326043982c8e"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:55.327546 19987 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 16:58:55.345110 20003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:55.347007 19987 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:58:55.347170 19987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "9029bfacc4bf45a6b0089db178537094"
format_stamp: "Formatted at 2026-08-06 16:58:55 on dist-test-slave-cbsf"
server_key: "b272641a4eacd92a43102645626b3659"
server_key_iv: "0350237080f9a89018c9326043982c8e"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:55.347317 19987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:55.384063 19987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:55.388442 19987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:55.388796 19987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:55.389813 19987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:55.391053 19987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:55.391120 19987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:55.391176 19987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:55.391243 19987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 16:58:55.405051 19987 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:46229
I20260806 16:58:55.406615 19987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:58:55.410341 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 19987
I20260806 16:58:55.410516 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:58:55.410857 7780 external_mini_cluster.cc:1428] Setting key 98584e306486f300693a0c6f48411c73
I20260806 16:58:55.425637 20121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:46229 every 8 connection(s)
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:55.449208 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.431901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:58647 (local address 127.7.153.62:39139)
0806 16:58:55.432043 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:55.432048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:55.433616 (+ 1568us) server_negotiation.cc:407] Connection header received
0806 16:58:55.434900 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:55.434905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:55.434970 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:55.435218 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:55.436786 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.437624 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.439458 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.439866 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.440003 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.443783 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:55.443804 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:55.443812 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:55.443860 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:55.446019 (+ 2159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:55.446847 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:55.446852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:55.446854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:55.446978 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:55.447435 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:55.447439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:55.447441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:55.447749 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:55.447873 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:55.448751 (+ 878us) server_negotiation.cc:299] Negotiation successful
0806 16:58:55.448938 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:58:55.450340 20126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.432524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:39139 (local address 127.7.153.2:58647)
0806 16:58:55.433369 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:55.433440 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:55.434613 (+ 1173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:55.435331 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:55.435341 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:55.435730 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:55.436468 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.436490 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.437831 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.437847 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.439268 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.439283 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.440087 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.440091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.440301 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.441117 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:55.441138 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:55.443305 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:55.446211 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:55.446221 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:55.446246 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:55.446690 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:55.447092 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:55.447096 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:55.447098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:55.447317 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:55.447888 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:55.447896 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:55.448376 (+ 480us) client_negotiation.cc:769] Sending connection context
0806 16:58:55.448637 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 16:58:55.449058 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":359,"threads_started":1}
I20260806 16:58:55.451804 20122 heartbeater.cc:347] Connected to a master server at 127.7.153.62:39139
I20260806 16:58:55.452097 20122 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:55.452785 20122 heartbeater.cc:511] Master 127.7.153.62:39139 requested a full tablet report, sending...
I20260806 16:58:55.454146 19758 ts_manager.cc:194] Registered new tserver with Master: 9029bfacc4bf45a6b0089db178537094 (127.7.153.2:46229)
I20260806 16:58:55.455040 19758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:58647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:58:55.485095 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:47135/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:39139
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
W20260806 16:58:55.706126 20128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:58:55.706730 20128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:58:55.706882 20128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:58:55.713795 20128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:58:55.713986 20128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:58:55.714147 20128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:58:55.723735 20128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.153.20:47135/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:39139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:58:55.725538 20128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:58:55.726984 20128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:58:55.740825 20134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:55.742880 20136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:58:55.744211 20133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:58:55.744706 20128 server_base.cc:1034] running on GCE node
I20260806 16:58:55.745569 20128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:58:55.746537 20128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:58:55.748158 20128 hybrid_clock.cc:648] HybridClock initialized: now 1786035535748115 us; error 65 us; skew 500 ppm
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:58:55.752182 20128 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:58:55.753470 20128 webserver.cc:460] Webserver started at http://127.7.153.3:36711/ using document root <none> and password file <none>
I20260806 16:58:55.754247 20128 fs_manager.cc:359] Metadata directory not provided
I20260806 16:58:55.754352 20128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:58:55.754659 20128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:58:55.778555 20128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "060f7784ddda4f8ca1034a022fda8add"
format_stamp: "Formatted at 2026-08-06 16:58:55 on dist-test-slave-cbsf"
server_key: "a14912f45a6891a4560440fe7a3666e9"
server_key_iv: "575278857c6d545aeb375fe50c93e277"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:55.781229 20128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "060f7784ddda4f8ca1034a022fda8add"
format_stamp: "Formatted at 2026-08-06 16:58:55 on dist-test-slave-cbsf"
server_key: "a14912f45a6891a4560440fe7a3666e9"
server_key_iv: "575278857c6d545aeb375fe50c93e277"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:55.788512 20128 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260806 16:58:55.816151 20143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:55.818130 20128 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:58:55.818298 20128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "060f7784ddda4f8ca1034a022fda8add"
format_stamp: "Formatted at 2026-08-06 16:58:55 on dist-test-slave-cbsf"
server_key: "a14912f45a6891a4560440fe7a3666e9"
server_key_iv: "575278857c6d545aeb375fe50c93e277"
server_key_version: "kuduclusterkey@0"
I20260806 16:58:55.818439 20128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:58:55.843572 20128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:58:55.847491 20128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:58:55.847713 20128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:58:55.848410 20128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:58:55.849630 20128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:58:55.849733 20128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:55.849818 20128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:58:55.849867 20128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:58:55.864504 20128 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:44909
I20260806 16:58:55.865164 20260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:44909 every 8 connection(s)
I20260806 16:58:55.865988 20128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:58:55.873802 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 20128
I20260806 16:58:55.873947 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:58:55.874261 7780 external_mini_cluster.cc:1428] Setting key 8b6338de7042bb8e7c2e6ad4501c4cc3
Aug 06 16:58:55 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:58:55.887261 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.869149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:49227 (local address 127.7.153.62:39139)
0806 16:58:55.869300 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:55.869305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:55.871121 (+ 1816us) server_negotiation.cc:407] Connection header received
0806 16:58:55.872365 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:55.872369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:55.872428 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:55.872527 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:55.874147 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.874955 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.876713 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.877081 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.877193 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.880941 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:55.880947 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:55.880950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:55.880988 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:55.883863 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:55.884892 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:55.884909 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:55.884911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:55.885035 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:55.885557 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:55.885563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:55.885565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:55.885912 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:55.886045 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:55.886929 (+ 884us) server_negotiation.cc:299] Negotiation successful
0806 16:58:55.887085 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 16:58:55.889696 20263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.869489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:39139 (local address 127.7.153.3:49227)
0806 16:58:55.870899 (+ 1410us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:55.870968 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:55.872091 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:55.872789 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:55.872800 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:55.873193 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:58:55.873957 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.873976 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.875132 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.875135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.876549 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.876562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.877435 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.877439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.877749 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.878584 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:58:55.878606 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:58:55.880641 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:58:55.884090 (+ 3449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:55.884101 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:55.884128 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:55.884639 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:55.885162 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:58:55.885166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:58:55.885168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:58:55.885410 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:58:55.886060 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:58:55.886069 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:58:55.886540 (+ 471us) client_negotiation.cc:769] Sending connection context
0806 16:58:55.886802 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 16:58:55.887242 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"thread_start_us":265,"threads_started":1}
I20260806 16:58:55.891079 20261 heartbeater.cc:347] Connected to a master server at 127.7.153.62:39139
I20260806 16:58:55.891352 20261 heartbeater.cc:464] Registering TS with master...
I20260806 16:58:55.891928 20261 heartbeater.cc:511] Master 127.7.153.62:39139 requested a full tablet report, sending...
I20260806 16:58:55.893102 19758 ts_manager.cc:194] Registered new tserver with Master: 060f7784ddda4f8ca1034a022fda8add (127.7.153.3:44909)
I20260806 16:58:55.893730 19758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:49227
I20260806 16:58:55.901676 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:58:55.913266 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.904239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54088 (local address 127.7.153.62:39139)
0806 16:58:55.904382 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:55.904387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:55.904778 (+ 391us) server_negotiation.cc:407] Connection header received
0806 16:58:55.904985 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:55.904988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:55.905040 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:55.905093 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:58:55.906115 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.906693 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.907624 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.907876 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.907997 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.909567 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:58:55.909571 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:58:55.909574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:58:55.909613 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:58:55.911106 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:55.911729 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:55.911735 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:55.911737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:55.911867 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:58:55.912245 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:58:55.912249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:58:55.912251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:58:55.912475 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:58:55.912630 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:55.912950 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 16:58:55.913082 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 16:58:55.917450 19758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:58:55.921618 19758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:58:55.944020 20275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.936534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46229 (local address 127.0.0.1:57546)
0806 16:58:55.937659 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:55.937673 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:55.937766 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:55.938781 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:55.938784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:55.938811 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:55.938910 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.938918 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.940387 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.940391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.941849 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.941861 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.943361 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.943365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.943479 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.943530 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 16:58:55.943651 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 16:58:55.943815 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1041,"mutex_wait_us":36,"spinlock_wait_cycles":896,"thread_start_us":129,"threads_started":1}
I20260806 16:58:55.944320 20274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.934824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56874 (local address 127.7.153.1:44007)
0806 16:58:55.937915 (+ 3091us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:55.937924 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:55.937955 (+ 31us) server_negotiation.cc:407] Connection header received
0806 16:58:55.938048 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:55.938055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:55.938315 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:55.938496 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:55.939149 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.940396 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.942220 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.943134 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.943783 (+ 649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.943965 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:55.944030 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 16:58:55.944148 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2954,"thread_start_us":126,"threads_started":1}
I20260806 16:58:55.944790 20273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.934634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44007 (local address 127.0.0.1:56874)
0806 16:58:55.937296 (+ 2662us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:55.937363 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:55.937530 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:55.938711 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:55.938719 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:55.938749 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:55.938976 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.938986 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.940566 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.940571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.942036 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.942051 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.943310 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.943316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.943465 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.943520 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 16:58:55.943633 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 16:58:55.944609 (+ 976us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2396,"mutex_wait_us":898,"thread_start_us":204,"threads_started":1}
I20260806 16:58:55.951364 20278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.938435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:44909 (local address 127.0.0.1:60980)
0806 16:58:55.944831 (+ 6396us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:55.944850 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:55.945059 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:55.945813 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:55.945818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:55.945841 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:55.945972 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.945981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.947643 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.947647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.949017 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:55.949034 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.950738 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.950743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:55.950950 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.950984 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 16:58:55.951078 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 16:58:55.951179 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6301,"thread_start_us":101,"threads_started":1}
I20260806 16:58:55.951547 19912 tablet_service.cc:1467] Processing CreateTablet for tablet 54622db19388456f91b6e09ec8ce9908 (DEFAULT_TABLE table=test-table [id=d3acc90b61de47aa829137ac38b38576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:58:55.952086 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.937008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60980 (local address 127.7.153.3:44909)
0806 16:58:55.937486 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:55.937500 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:55.945229 (+ 7729us) server_negotiation.cc:407] Connection header received
0806 16:58:55.945344 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:55.945350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:55.945624 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:55.945821 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:55.946219 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.947489 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.949265 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.950230 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.950363 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.950545 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:55.951621 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0806 16:58:55.951759 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":176,"threads_started":1}
I20260806 16:58:55.952653 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:55.937018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57546 (local address 127.7.153.2:46229)
0806 16:58:55.938115 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:55.938136 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:55.938162 (+ 26us) server_negotiation.cc:407] Connection header received
0806 16:58:55.938245 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:55.938250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:55.938450 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:55.938618 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:55.939062 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.940237 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.942023 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:55.942936 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:55.943073 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:55.943282 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:55.952344 (+ 9062us) server_negotiation.cc:299] Negotiation successful
0806 16:58:55.952489 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":142,"threads_started":1}
I20260806 16:58:55.955377 20050 tablet_service.cc:1467] Processing CreateTablet for tablet 54622db19388456f91b6e09ec8ce9908 (DEFAULT_TABLE table=test-table [id=d3acc90b61de47aa829137ac38b38576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:58:55.955381 20194 tablet_service.cc:1467] Processing CreateTablet for tablet 54622db19388456f91b6e09ec8ce9908 (DEFAULT_TABLE table=test-table [id=d3acc90b61de47aa829137ac38b38576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:58:55.956646 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54622db19388456f91b6e09ec8ce9908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:55.956646 20194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54622db19388456f91b6e09ec8ce9908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:55.961555 19912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54622db19388456f91b6e09ec8ce9908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:58:55.969014 20279 tablet_bootstrap.cc:492] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Bootstrap starting.
I20260806 16:58:55.972610 20279 tablet_bootstrap.cc:654] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:55.975019 20279 log.cc:824] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:55.977443 20280 tablet_bootstrap.cc:492] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Bootstrap starting.
I20260806 16:58:55.977675 20279 tablet_bootstrap.cc:492] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: No bootstrap required, opened a new log
I20260806 16:58:55.977890 20279 ts_tablet_manager.cc:1397] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 16:58:55.980592 20280 tablet_bootstrap.cc:654] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:55.981323 20282 tablet_bootstrap.cc:492] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: Bootstrap starting.
I20260806 16:58:55.982545 20279 raft_consensus.cc:348] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:55.982879 20279 raft_consensus.cc:374] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:55.982936 20279 raft_consensus.cc:729] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 060f7784ddda4f8ca1034a022fda8add, State: Initialized, Role: FOLLOWER
I20260806 16:58:55.984457 20282 tablet_bootstrap.cc:654] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: Neither blocks nor log segments found. Creating new log.
I20260806 16:58:55.984771 20279 consensus_queue.cc:260] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:55.985600 20280 log.cc:824] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:55.986277 20279 ts_tablet_manager.cc:1428] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260806 16:58:55.986601 20282 log.cc:824] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: Log is configured to *not* fsync() on all Append() calls
I20260806 16:58:55.986809 20261 heartbeater.cc:503] Master 127.7.153.62:39139 was elected leader, sending a full tablet report...
I20260806 16:58:55.990337 20280 tablet_bootstrap.cc:492] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: No bootstrap required, opened a new log
I20260806 16:58:55.990669 20280 ts_tablet_manager.cc:1397] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260806 16:58:55.997494 20282 tablet_bootstrap.cc:492] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: No bootstrap required, opened a new log
I20260806 16:58:55.997876 20282 ts_tablet_manager.cc:1397] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260806 16:58:55.998135 20280 raft_consensus.cc:348] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:55.998585 20280 raft_consensus.cc:374] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:55.998684 20280 raft_consensus.cc:729] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9029bfacc4bf45a6b0089db178537094, State: Initialized, Role: FOLLOWER
I20260806 16:58:55.999267 20280 consensus_queue.cc:260] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:56.000583 20280 ts_tablet_manager.cc:1428] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260806 16:58:56.001104 20122 heartbeater.cc:503] Master 127.7.153.62:39139 was elected leader, sending a full tablet report...
I20260806 16:58:56.003262 20282 raft_consensus.cc:348] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:56.003851 20282 raft_consensus.cc:374] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:58:56.003952 20282 raft_consensus.cc:729] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eadf395dba3a4dbb8c3bbacf81358cf0, State: Initialized, Role: FOLLOWER
I20260806 16:58:56.004508 20282 consensus_queue.cc:260] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:56.005792 20282 ts_tablet_manager.cc:1428] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260806 16:58:56.006142 19981 heartbeater.cc:503] Master 127.7.153.62:39139 was elected leader, sending a full tablet report...
Aug 06 16:58:56 dist-test-slave-cbsf krb5kdc[19256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035535, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
W20260806 16:58:56.118965 20262 tablet.cc:2369] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 16:58:56.181617 20123 tablet.cc:2369] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:58:56.215483 20287 raft_consensus.cc:482] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:58:56.215766 20287 raft_consensus.cc:504] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:56.217759 20287 leader_election.cc:288] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9029bfacc4bf45a6b0089db178537094 (127.7.153.2:46229), 060f7784ddda4f8ca1034a022fda8add (127.7.153.3:44909)
W20260806 16:58:56.223106 19982 tablet.cc:2369] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:58:56.229640 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:56.218979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:39883 (local address 127.7.153.2:46229)
0806 16:58:56.219124 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:56.219129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:56.220321 (+ 1192us) server_negotiation.cc:407] Connection header received
0806 16:58:56.220563 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:56.220568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:56.220635 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:56.220716 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:56.221213 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.222020 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.225348 (+ 3328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.226023 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.226123 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:56.226211 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:56.229342 (+ 3131us) server_negotiation.cc:299] Negotiation successful
0806 16:58:56.229477 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 16:58:56.230410 20290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:56.218218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46229 (local address 127.7.153.1:39883)
0806 16:58:56.220213 (+ 1995us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:56.220230 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:56.220418 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:56.220887 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:56.220892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:56.220914 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:56.221063 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:56.221071 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.222218 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.222222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:56.225102 (+ 2880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:56.225112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.227293 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.227297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:56.227427 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:56.227459 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 16:58:56.230117 (+ 2658us) client_negotiation.cc:240] Negotiation successful
0806 16:58:56.230228 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1922,"thread_start_us":121,"threads_started":1}
I20260806 16:58:56.232237 20075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54622db19388456f91b6e09ec8ce9908" candidate_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9029bfacc4bf45a6b0089db178537094" is_pre_election: true
I20260806 16:58:56.232653 20075 raft_consensus.cc:2454] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadf395dba3a4dbb8c3bbacf81358cf0 in term 0.
I20260806 16:58:56.234054 19862 leader_election.cc:302] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9029bfacc4bf45a6b0089db178537094, eadf395dba3a4dbb8c3bbacf81358cf0; no voters:
I20260806 16:58:56.234472 20287 raft_consensus.cc:2781] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:58:56.234565 20287 raft_consensus.cc:482] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:58:56.234628 20287 raft_consensus.cc:3037] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:56.236117 20287 raft_consensus.cc:504] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:56.236547 20287 leader_election.cc:288] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 9029bfacc4bf45a6b0089db178537094 (127.7.153.2:46229), 060f7784ddda4f8ca1034a022fda8add (127.7.153.3:44909)
I20260806 16:58:56.237504 20075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54622db19388456f91b6e09ec8ce9908" candidate_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9029bfacc4bf45a6b0089db178537094"
I20260806 16:58:56.237686 20075 raft_consensus.cc:3037] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:56.239214 20075 raft_consensus.cc:2454] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadf395dba3a4dbb8c3bbacf81358cf0 in term 1.
I20260806 16:58:56.240047 19862 leader_election.cc:302] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9029bfacc4bf45a6b0089db178537094, eadf395dba3a4dbb8c3bbacf81358cf0; no voters:
I20260806 16:58:56.240587 20287 raft_consensus.cc:2781] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:58:56.240917 20287 raft_consensus.cc:686] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [term 1 LEADER]: Becoming Leader. State: Replica: eadf395dba3a4dbb8c3bbacf81358cf0, State: Running, Role: LEADER
I20260806 16:58:56.241372 20287 consensus_queue.cc:237] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } }
I20260806 16:58:56.244449 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:56.219915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:41199 (local address 127.7.153.3:44909)
0806 16:58:56.220039 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:56.220043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:56.224056 (+ 4013us) server_negotiation.cc:407] Connection header received
0806 16:58:56.224360 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:56.224364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:56.224436 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:56.224492 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:58:56.226312 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.227077 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.232684 (+ 5607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.233375 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.233478 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:56.233553 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:56.244188 (+ 10635us) server_negotiation.cc:299] Negotiation successful
0806 16:58:56.244305 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 16:58:56.245141 20291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:56.219476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:44909 (local address 127.7.153.1:41199)
0806 16:58:56.223916 (+ 4440us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:56.223936 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:56.224171 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:56.224761 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:58:56.224765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:58:56.224786 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:58:56.224927 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:56.224935 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.227626 (+ 2691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.227630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:56.232355 (+ 4725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:58:56.232373 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.243819 (+ 11446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.243823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:58:56.243971 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:56.244002 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 16:58:56.244870 (+ 868us) client_negotiation.cc:240] Negotiation successful
0806 16:58:56.244973 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4262,"thread_start_us":130,"threads_started":1}
I20260806 16:58:56.245474 19758 catalog_manager.cc:5495] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eadf395dba3a4dbb8c3bbacf81358cf0 (127.7.153.1). New cstate: current_term: 1 leader_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 } health_report { overall_health: UNKNOWN } } }
I20260806 16:58:56.246869 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54622db19388456f91b6e09ec8ce9908" candidate_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "060f7784ddda4f8ca1034a022fda8add" is_pre_election: true
I20260806 16:58:56.247229 20214 raft_consensus.cc:2454] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eadf395dba3a4dbb8c3bbacf81358cf0 in term 0.
I20260806 16:58:56.247632 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54622db19388456f91b6e09ec8ce9908" candidate_uuid: "eadf395dba3a4dbb8c3bbacf81358cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "060f7784ddda4f8ca1034a022fda8add"
I20260806 16:58:56.247754 20213 raft_consensus.cc:3037] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:58:56.249364 20213 raft_consensus.cc:2454] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eadf395dba3a4dbb8c3bbacf81358cf0 in term 1.
I20260806 16:58:56.316936 20274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:56.311017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56890 (local address 127.7.153.1:44007)
0806 16:58:56.311144 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 16:58:56.311148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:58:56.311164 (+ 16us) server_negotiation.cc:407] Connection header received
0806 16:58:56.311275 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:58:56.311278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:58:56.311350 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:58:56.311501 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:58:56.311918 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.312762 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.314077 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:58:56.314427 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:58:56.314539 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:58:56.315003 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:58:56.315834 (+ 831us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:58:56.315988 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 16:58:56.316538 (+ 550us) server_negotiation.cc:299] Negotiation successful
0806 16:58:56.316620 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 16:58:56.332150 20213 raft_consensus.cc:1261] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 1 FOLLOWER]: Refusing update from remote peer eadf395dba3a4dbb8c3bbacf81358cf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:58:56.333202 20075 raft_consensus.cc:1261] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 1 FOLLOWER]: Refusing update from remote peer eadf395dba3a4dbb8c3bbacf81358cf0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:58:56.334280 20292 consensus_queue.cc:1035] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9029bfacc4bf45a6b0089db178537094" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:58:56.335490 20292 consensus_queue.cc:1035] T 54622db19388456f91b6e09ec8ce9908 P eadf395dba3a4dbb8c3bbacf81358cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "060f7784ddda4f8ca1034a022fda8add" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 44909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:58:56.360845 20295 mvcc.cc:205] Tried to move back new op lower bound from 7315601556801794048 to 7315601556448862208. Current Snapshot: MvccSnapshot[applied={T|T < 7315601556801794048}]
I20260806 16:58:56.374607 20296 mvcc.cc:205] Tried to move back new op lower bound from 7315601556801794048 to 7315601556448862208. Current Snapshot: MvccSnapshot[applied={T|T < 7315601556801794048}]
I20260806 16:58:56.374928 20298 mvcc.cc:205] Tried to move back new op lower bound from 7315601556801794048 to 7315601556448862208. Current Snapshot: MvccSnapshot[applied={T|T < 7315601556801794048}]
I20260806 16:58:56.389494 19758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:58:56.389706 19758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:58:56.393175 19758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59381a6349ae4a4c92e21a49ad37b0cd: Sending DeleteTablet for 3 replicas of tablet 54622db19388456f91b6e09ec8ce9908
I20260806 16:58:56.394518 19912 tablet_service.cc:1514] Processing DeleteTablet for tablet 54622db19388456f91b6e09ec8ce9908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:58:56 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:56874
I20260806 16:58:56.395145 20194 tablet_service.cc:1514] Processing DeleteTablet for tablet 54622db19388456f91b6e09ec8ce9908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:58:56 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:60980
I20260806 16:58:56.395776 20050 tablet_service.cc:1514] Processing DeleteTablet for tablet 54622db19388456f91b6e09ec8ce9908 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:58:56 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:57546
I20260806 16:58:56.395937 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 19842
I20260806 16:58:56.401336 20309 tablet_replica.cc:330] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: stopping tablet replica
I20260806 16:58:56.401803 20309 raft_consensus.cc:2229] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:58:56.402280 20309 raft_consensus.cc:2258] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:58:56.402591 20306 tablet_replica.cc:330] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: stopping tablet replica
I20260806 16:58:56.402987 20306 raft_consensus.cc:2229] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:58:56.403734 20306 raft_consensus.cc:2258] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:58:56.405349 20309 ts_tablet_manager.cc:1905] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:58:56.407058 20306 ts_tablet_manager.cc:1905] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:58:56.410838 20306 ts_tablet_manager.cc:1918] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:58:56.413882 20309 ts_tablet_manager.cc:1918] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260806 16:58:56.413872 19742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:44007 (error 108)
I20260806 16:58:56.414155 20309 log.cc:1196] T 54622db19388456f91b6e09ec8ce9908 P 9029bfacc4bf45a6b0089db178537094: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/54622db19388456f91b6e09ec8ce9908
I20260806 16:58:56.414358 20306 log.cc:1196] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/54622db19388456f91b6e09ec8ce9908
I20260806 16:58:56.414822 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 19987
I20260806 16:58:56.414923 20306 ts_tablet_manager.cc:1939] T 54622db19388456f91b6e09ec8ce9908 P 060f7784ddda4f8ca1034a022fda8add: Deleting consensus metadata
I20260806 16:58:56.417392 19743 catalog_manager.cc:4841] TS 060f7784ddda4f8ca1034a022fda8add (127.7.153.3:44909): tablet 54622db19388456f91b6e09ec8ce9908 (table test-table [id=d3acc90b61de47aa829137ac38b38576]) successfully deleted
I20260806 16:58:56.420488 20278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:58:56.420041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44007 (local address 127.0.0.1:56898)
0806 16:58:56.420280 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:56.420374 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:44007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260806 16:58:56.421046 19742 catalog_manager.cc:4584] TS eadf395dba3a4dbb8c3bbacf81358cf0 (127.7.153.1:44007): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 54622db19388456f91b6e09ec8ce9908: Network error: Client connection negotiation failed: client connection to 127.7.153.1:44007: connect: Connection refused (error 111)
W20260806 16:58:56.430706 20278 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 16:58:56.430033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46229 (local address 127.0.0.1:57562)
0806 16:58:56.430249 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 16:58:56.430266 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:58:56.430368 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:58:56.430569 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.2:46229: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":131}
I20260806 16:58:56.431595 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 20128
I20260806 16:58:56.445596 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 19721
I20260806 16:58:56.456283 7780 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 16:58:56.802384 7780 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 16:58:56.802528 7780 mini_ranger.cc:66] Stopping Ranger...
I20260806 16:58:57.148533 7780 mini_ranger.cc:68] Stopped Ranger
2026-08-06 16:58:57.148 UTC [19288] LOG: received smart shutdown request
2026-08-06 16:58:57.153 UTC [19288] LOG: background worker "logical replication launcher" (PID 19297) exited with exit code 1
2026-08-06 16:58:57.153 UTC [19292] LOG: shutting down
2026-08-06 16:58:57.379 UTC [19288] LOG: database system is shut down
2026-08-06T16:58:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (52205 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:58:57 dist-test-slave-cbsf krb5kdc[20326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:58:57 dist-test-slave-cbsf krb5kdc[20326](info): set up 2 sockets
Aug 06 16:58:57 dist-test-slave-cbsf krb5kdc[20326](info): commencing operation
krb5kdc: starting...
W20260806 16:58:58.625447 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:58:58 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:58:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:58:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/rangeradmin_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/rangeradmin_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/rangerlookup_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/rangerlookup_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
I20260806 16:58:58.837843 7780 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskOJ6ny6/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/postgres -l logfile start
2026-08-06 16:59:01.692 UTC [20360] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 16:59:01.692 UTC [20360] LOG: listening on IPv4 address "127.7.153.20", port 36069
2026-08-06 16:59:01.696 UTC [20360] LOG: listening on Unix socket "/tmp/.s.PGSQL.36069"
2026-08-06 16:59:01.719 UTC [20363] LOG: database system was shut down at 2026-08-06 16:59:00 UTC
2026-08-06 16:59:01.723 UTC [20360] LOG: database system is ready to accept connections
I20260806 16:59:02.721329 7780 mini_postgres.cc:96] Postgres bound to 36069
2026-08-06 16:59:02.729 UTC [20371] FATAL: database "slave" does not exist
127.7.153.20:36069 - accepting connections
I20260806 16:59:02.730113 7780 mini_ranger.cc:161] Starting Ranger...
I20260806 16:59:02.749269 7780 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 16:59:03.340662 7780 mini_ranger.cc:87] Created ranger Postgres database
I20260806 16:59:03.340826 7780 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-admin
2026-08-06 16:59:03,650 [I] DB FLAVOR :POSTGRES
2026-08-06 16:59:03,650 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 16:59:03,650 [I] Checking connection..
2026-08-06 16:59:03,650 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 16:59:03,920 [I] Checking connection passed.
2026-08-06 16:59:03,920 [I] --------- Verifying version history table ---------
2026-08-06 16:59:03,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 16:59:04,191 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 16:59:04,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 16:59:04,449 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 16:59:04,449 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 16:59:04,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 16:59:04.709 UTC [20437] WARNING: there is no transaction in progress
2026-08-06 16:59:04,717 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 16:59:04,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 16:59:04,984 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 16:59:04,985 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 16:59:04,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 16:59:05,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 16:59:05,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-cbsf.c.gcp-upstream.internal','N') ;"
2026-08-06 16:59:05,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 16:59:06,063 [I] Table x_portal_user does not exist in database ranger
2026-08-06 16:59:06,064 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 16:59:06,342 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 16:59:06,342 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 16:59:06,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 16:59:06,896 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 16:59:06,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 16:59:08.057 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.078 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.101 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.122 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.142 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.163 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.231 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.239 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.256 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.269 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.281 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.298 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.310 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.318 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.327 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:08.336 UTC [20549] WARNING: there is no transaction in progress
2026-08-06 16:59:09,181 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 16:59:09,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 16:59:09,459 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 16:59:09,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 16:59:09,734 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 16:59:09,734 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 16:59:10,013 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 16:59:10,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 16:59:10,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 16:59:10,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-cbsf.c.gcp-upstream.internal';"
2026-08-06 16:59:10,800 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 16:59:10,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 16:59:11,070 [I] DB_PATCHES have already been applied
I20260806 16:59:11.079598 7780 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-admin:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskOJ6ny6/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 16:59:11.079697 7780 mini_ranger.cc:193] Using host: 127.7.153.20
I20260806 16:59:11.085196 7780 mini_ranger.cc:227] Ranger admin URL: http://127.7.153.20:39799
Aug 06, 2026 4:59:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:59:11 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:59:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 4:59:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 4:59:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 4:59:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 4:59:12 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 16:59:12.276216 7780 mini_ranger.cc:160] Time spent starting Ranger: real 9.546s user 0.002s sys 0.012s
Aug 06, 2026 4:59:35 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 4:59:35 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 4:59:35 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 4:59:35 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 4:59:36 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 16:59:37.522296 7780 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.153.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.153.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/rangerkms_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.153.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/rangerkms_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.153.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.153.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.153.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/HTTP_127.7.153.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 16:59:37 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035577, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 16:59:37.622707 7780 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 16:59:37.636322 7780 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 16:59:38.633432 7780 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 16:59:38.633517 7780 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms
I20260806 16:59:38.633529 7780 mini_ranger_kms.cc:227] Using postgres at 127.7.153.20:36069
2026-08-06 16:59:38,834 [I] DB FLAVOR :POSTGRES
2026-08-06 16:59:38,835 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 16:59:38,835 [I] Checking connection
2026-08-06 16:59:38,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 16:59:39,105 [I] connection success
2026-08-06 16:59:39,105 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 16:59:39,105 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 16:59:39,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 16:59:39,352 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 16:59:39,353 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 16:59:39,353 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 16:59:39,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.153.20:36069/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 16:59:39,658 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 16:59:40.223704 7780 mini_ranger_kms.cc:310] Created kms service
I20260806 16:59:40.440143 7780 mini_ranger_kms.cc:326] Created kudu user
I20260806 16:59:40.491611 7780 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 16:59:40 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035577, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:40.955201 7780 mini_ranger_kms.cc:384] Added ranger policy
I20260806 16:59:40.955366 7780 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms:/tmp/dist-test-taskOJ6ny6/build/debug/bin/postgresql.jar:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskOJ6ny6/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 16:59:40.955387 7780 mini_ranger_kms.cc:240] Using host: 127.7.153.20
I20260806 16:59:40.960963 7780 mini_ranger_kms.cc:276] Ranger KMS PID: 20742
I20260806 16:59:40.961086 7780 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.153.20:60415
Aug 06, 2026 4:59:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 4:59:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 4:59:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 4:59:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 4:59:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 4:59:42 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 16:59:43.466229 7780 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.844s user 0.013s sys 0.171s
I20260806 16:59:43.466365 7780 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 16:59:43.466441 7780 mini_ranger_kms.cc:401] 127.7.153.20:60415/kms/v1/keys
Aug 06 16:59:43 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786035583, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.153.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 16:59:43 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035583, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.153.20@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
Aug 06 16:59:44 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035583, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.153.20@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
Aug 06 16:59:46 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:59:46.892599 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41669
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:41669
--ranger_config_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:47.023758 20797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:47.024094 20797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:47.024137 20797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:47.028412 20797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:47.028501 20797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:47.028522 20797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:47.028538 20797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:47.028558 20797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:47.034745 20797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.153.20:60415/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:41669
--ranger_config_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:47.036005 20797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:47.037249 20797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 16:59:47.047371 20797 server_base.cc:1034] running on GCE node
W20260806 16:59:47.047299 20803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:47.047299 20805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:47.047320 20802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:47.048449 20797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:47.049851 20797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:47.051131 20797 hybrid_clock.cc:648] HybridClock initialized: now 1786035587051092 us; error 62 us; skew 500 ppm
Aug 06 16:59:47 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035587, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:47.061235 20797 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:59:47.062451 20797 webserver.cc:460] Webserver started at http://127.7.153.62:33765/ using document root <none> and password file <none>
I20260806 16:59:47.063102 20797 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:47.063191 20797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:47.063457 20797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:59:47 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035587, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:47.123333 20797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "70657d7073514a458654380b5cca993d"
format_stamp: "Formatted at 2026-08-06 16:59:47 on dist-test-slave-cbsf"
server_key: "5af7cbfa663e658c3ee9934e850841a6"
server_key_iv: "1fc44dffe64c10f8c3af8c57f941faf4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:47.124274 20797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "70657d7073514a458654380b5cca993d"
format_stamp: "Formatted at 2026-08-06 16:59:47 on dist-test-slave-cbsf"
server_key: "5af7cbfa663e658c3ee9934e850841a6"
server_key_iv: "1fc44dffe64c10f8c3af8c57f941faf4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:47.130280 20797 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 16:59:47.146384 20812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:47.147902 20797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 16:59:47.148077 20797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "70657d7073514a458654380b5cca993d"
format_stamp: "Formatted at 2026-08-06 16:59:47 on dist-test-slave-cbsf"
server_key: "5af7cbfa663e658c3ee9934e850841a6"
server_key_iv: "1fc44dffe64c10f8c3af8c57f941faf4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:47.148238 20797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:47.163501 20797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:47.166985 20797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:47.167224 20797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:47.175468 20797 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:41669
I20260806 16:59:47.175536 20867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:41669 every 8 connection(s)
I20260806 16:59:47.176611 20797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:59:47.179910 20868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:47.183043 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 20797
I20260806 16:59:47.183172 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:59:47.183501 7780 external_mini_cluster.cc:1428] Setting key 70dde1d04c144fa614c3b964af226b8c
I20260806 16:59:47.186647 20868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Bootstrap starting.
I20260806 16:59:47.189631 20868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:47.190623 20868 log.cc:824] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:47.192884 20868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: No bootstrap required, opened a new log
Aug 06 16:59:47 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:47.196597 20868 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:47.196947 20868 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:47.197032 20868 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70657d7073514a458654380b5cca993d, State: Initialized, Role: FOLLOWER
I20260806 16:59:47.197552 20868 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:47.197722 20868 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:59:47.197813 20868 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:59:47.197959 20868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:47.199100 20868 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:47.199270 20871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:47.185106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50322 (local address 127.7.153.62:41669)
0806 16:59:47.185594 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:47.185609 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:47.185648 (+ 39us) server_negotiation.cc:407] Connection header received
0806 16:59:47.186305 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:47.186323 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:47.186681 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:47.187028 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:47.188014 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:47.189135 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:47.190419 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:47.191001 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:47.191197 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:47.193997 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:47.194003 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:47.194021 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:47.194054 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:47.195829 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:47.196352 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:47.196358 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:47.196364 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:47.196485 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:47.196870 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:47.196873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:47.196875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:47.197491 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:47.197742 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:47.198054 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 16:59:47.198377 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":146,"threads_started":1}
I20260806 16:59:47.199568 20868 leader_election.cc:302] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70657d7073514a458654380b5cca993d; no voters:
I20260806 16:59:47.199965 20868 leader_election.cc:288] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:59:47.200093 20873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:59:47.200325 20873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 LEADER]: Becoming Leader. State: Replica: 70657d7073514a458654380b5cca993d, State: Running, Role: LEADER
I20260806 16:59:47.201313 20868 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:59:47.201849 20873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:47.203737 20875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70657d7073514a458654380b5cca993d. Latest consensus state: current_term: 1 leader_uuid: "70657d7073514a458654380b5cca993d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } } }
I20260806 16:59:47.203900 20875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:47.204087 20868 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 16:59:47.204201 20874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70657d7073514a458654380b5cca993d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } } }
I20260806 16:59:47.204288 20874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:47.204733 20887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:59:47.213938 20887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:59:47.223208 20887 catalog_manager.cc:1347] Generated new cluster ID: 828f8abc38f24c1c8e0416375124bb23
I20260806 16:59:47.223356 20887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:59:47.233997 20887 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:59:47.235639 20887 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:59:47.249166 20887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Generated new TSK 0
I20260806 16:59:47.250377 20887 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:59:48.039670 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41669
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:48.206347 20914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:48.206678 20914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:48.206727 20914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:48.212577 20914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:48.212668 20914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:48.212806 20914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:59:48.219718 20914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.153.20:60415/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:48.221095 20914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:48.222527 20914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:48.236783 20923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:48.236822 20914 server_base.cc:1034] running on GCE node
W20260806 16:59:48.236918 20926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:48.237138 20924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:48.237625 20914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:48.238487 20914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:48.239706 20914 hybrid_clock.cc:648] HybridClock initialized: now 1786035588239686 us; error 47 us; skew 500 ppm
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:48.244122 20914 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:59:48.245836 20914 webserver.cc:460] Webserver started at http://127.7.153.1:39437/ using document root <none> and password file <none>
I20260806 16:59:48.246702 20914 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:48.246810 20914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:48.247159 20914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:48.264215 20914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "8ba305e7b94d4160b83d689d3586557b"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "e6307b5d269c06cd2cb720a75c012e08"
server_key_iv: "e4a75192140eae5c74222b1db36e156e"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:48.265226 20914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "8ba305e7b94d4160b83d689d3586557b"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "e6307b5d269c06cd2cb720a75c012e08"
server_key_iv: "e4a75192140eae5c74222b1db36e156e"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:48.278493 20914 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.000s
I20260806 16:59:48.295775 20934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:48.297616 20914 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:59:48.297861 20914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "8ba305e7b94d4160b83d689d3586557b"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "e6307b5d269c06cd2cb720a75c012e08"
server_key_iv: "e4a75192140eae5c74222b1db36e156e"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:48.298168 20914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:48.326464 20914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:48.331187 20914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:48.331494 20914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:48.332429 20914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:48.333781 20914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:48.333901 20914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:48.334033 20914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:48.334128 20914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:48.347096 20914 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:37649
I20260806 16:59:48.350347 20914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:59:48.352743 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 20914
I20260806 16:59:48.352886 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:59:48.353277 7780 external_mini_cluster.cc:1428] Setting key cc1a51770cb62ce7069d0a8d762b0422
I20260806 16:59:48.361848 21053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:37649 every 8 connection(s)
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:59:48.376811 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:48.355508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:35989 (local address 127.7.153.62:41669)
0806 16:59:48.360952 (+ 5444us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:48.360958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:48.360982 (+ 24us) server_negotiation.cc:407] Connection header received
0806 16:59:48.361044 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:48.361048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:48.361112 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:48.361241 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:48.363293 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.364133 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.366384 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.366866 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.366982 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:48.370758 (+ 3776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:48.370766 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:48.370770 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:48.370814 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:48.373278 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:48.374191 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:48.374197 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:48.374199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:48.374348 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:48.374899 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:48.374904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:48.374907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:48.375235 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:48.375336 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:48.376361 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0806 16:59:48.376542 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5325,"thread_start_us":128,"threads_started":1}
I20260806 16:59:48.379339 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:48.354213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41669 (local address 127.7.153.1:35989)
0806 16:59:48.357723 (+ 3510us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:48.357809 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:48.359112 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:48.361691 (+ 2579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:48.361707 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:48.362158 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:48.363021 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:48.363051 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.364319 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.364326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:48.366177 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:48.366196 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.367293 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.367300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:48.367566 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:48.368380 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:48.368411 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:48.370419 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:48.373474 (+ 3055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:48.373486 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:48.373514 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:48.373995 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:48.374522 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:48.374525 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:48.374527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:48.374757 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:48.375417 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:48.375427 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:48.375905 (+ 478us) client_negotiation.cc:769] Sending connection context
0806 16:59:48.377660 (+ 1755us) client_negotiation.cc:240] Negotiation successful
0806 16:59:48.378135 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3171,"thread_start_us":195,"threads_started":1}
I20260806 16:59:48.381735 21054 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41669
I20260806 16:59:48.382048 21054 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:48.382772 21054 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:48.385250 20830 ts_manager.cc:194] Registered new tserver with Master: 8ba305e7b94d4160b83d689d3586557b (127.7.153.1:37649)
I20260806 16:59:48.386945 20830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:35989
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:59:48.433562 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41669
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 16:59:48.620353 21062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:48.620828 21062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:48.620905 21062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:48.627581 21062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:48.627691 21062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:48.627784 21062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:59:48.636420 21062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.153.20:60415/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:48.638334 21062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:48.639915 21062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:48.655462 21072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:48.655606 21070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:48.655462 21069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:48.657032 21062 server_base.cc:1034] running on GCE node
I20260806 16:59:48.657608 21062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:48.658610 21062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:48.659991 21062 hybrid_clock.cc:648] HybridClock initialized: now 1786035588659916 us; error 106 us; skew 500 ppm
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:48.664552 21062 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:59:48.665967 21062 webserver.cc:460] Webserver started at http://127.7.153.2:44577/ using document root <none> and password file <none>
I20260806 16:59:48.666792 21062 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:48.666908 21062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:48.667201 21062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:48.692191 21062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "a732d2b88a234587a7b81629ef052d46"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "891168005fcb64a0bafa021443085827"
server_key_iv: "bd676b257016e8d00b5b7d48d1096aac"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:48.693105 21062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "a732d2b88a234587a7b81629ef052d46"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "891168005fcb64a0bafa021443085827"
server_key_iv: "bd676b257016e8d00b5b7d48d1096aac"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:48.702636 21062 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.000s
I20260806 16:59:48.725178 21079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:48.727468 21062 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260806 16:59:48.727772 21062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "a732d2b88a234587a7b81629ef052d46"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "891168005fcb64a0bafa021443085827"
server_key_iv: "bd676b257016e8d00b5b7d48d1096aac"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:48.728061 21062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:48.759449 21062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:48.763897 21062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:48.764212 21062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:48.765681 21062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:48.767282 21062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:48.767412 21062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:48.767529 21062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:48.767609 21062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:48.786391 21062 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:42749
I20260806 16:59:48.786499 21197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:42749 every 8 connection(s)
I20260806 16:59:48.788072 21062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:59:48.801441 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21062
I20260806 16:59:48.801606 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:59:48.801925 7780 external_mini_cluster.cc:1428] Setting key a33b422a75e14e8a90d0283e6922720d
Aug 06 16:59:48 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:48.810748 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:48.793043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:44489 (local address 127.7.153.62:41669)
0806 16:59:48.793185 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:48.793192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:48.793210 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:59:48.794161 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:48.794165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:48.794231 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:48.794286 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:48.796207 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.797054 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.799000 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.799364 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.799447 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:48.805610 (+ 6163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:48.805614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:48.805617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:48.805651 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:48.807709 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:48.808572 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:48.808579 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:48.808584 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:48.808687 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:48.809341 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:48.809345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:48.809347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:48.809590 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:48.809722 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:48.810395 (+ 673us) server_negotiation.cc:299] Negotiation successful
0806 16:59:48.810566 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 16:59:48.811800 21200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:48.791499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41669 (local address 127.7.153.2:44489)
0806 16:59:48.792328 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:48.792392 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:48.793837 (+ 1445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:48.794737 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:48.794747 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:48.795222 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:48.795989 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:48.796011 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.797279 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.797282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:48.798828 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:48.798843 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:48.799693 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:48.799697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:48.799998 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:48.802900 (+ 2902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:48.802925 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:48.805332 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:48.807890 (+ 2558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:48.807902 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:48.807930 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:48.808432 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:48.808851 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:48.808856 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:48.808859 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:48.809196 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:48.809723 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:48.809734 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:48.810121 (+ 387us) client_negotiation.cc:769] Sending connection context
0806 16:59:48.810354 (+ 233us) client_negotiation.cc:240] Negotiation successful
0806 16:59:48.810728 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":244,"threads_started":1}
I20260806 16:59:48.813210 21198 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41669
I20260806 16:59:48.813601 21198 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:48.814255 21198 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:48.815658 20830 ts_manager.cc:194] Registered new tserver with Master: a732d2b88a234587a7b81629ef052d46 (127.7.153.2:42749)
I20260806 16:59:48.816291 20830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:44489
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:59:48.869016 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41669
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035588, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
W20260806 16:59:49.073351 21203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:49.073860 21203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:49.073984 21203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:49.080184 21203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:49.080372 21203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:49.080518 21203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:59:49.088668 21203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.153.20:60415/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:49.090039 21203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:49.091275 21203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:49.105116 21208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:49.105151 21209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:49.105877 21212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:49.106345 21203 server_base.cc:1034] running on GCE node
I20260806 16:59:49.106953 21203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:49.107942 21203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:49.109346 21203 hybrid_clock.cc:648] HybridClock initialized: now 1786035589109316 us; error 42 us; skew 500 ppm
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:49.113970 21203 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:59:49.115514 21203 webserver.cc:460] Webserver started at http://127.7.153.3:37531/ using document root <none> and password file <none>
I20260806 16:59:49.116375 21203 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:49.116521 21203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:49.116861 21203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:49.137223 21203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "af403b7e621e46e6aff52d1dfaf59a13"
format_stamp: "Formatted at 2026-08-06 16:59:49 on dist-test-slave-cbsf"
server_key: "bc6185afaae397ab46e59cd38b7e768a"
server_key_iv: "b84dcb805ad5d5412be7a88afa9c9ec4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:49.138180 21203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "af403b7e621e46e6aff52d1dfaf59a13"
format_stamp: "Formatted at 2026-08-06 16:59:49 on dist-test-slave-cbsf"
server_key: "bc6185afaae397ab46e59cd38b7e768a"
server_key_iv: "b84dcb805ad5d5412be7a88afa9c9ec4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:49.143817 21203 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 16:59:49.166085 21219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.168149 21203 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 16:59:49.168331 21203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "af403b7e621e46e6aff52d1dfaf59a13"
format_stamp: "Formatted at 2026-08-06 16:59:49 on dist-test-slave-cbsf"
server_key: "bc6185afaae397ab46e59cd38b7e768a"
server_key_iv: "b84dcb805ad5d5412be7a88afa9c9ec4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:49.168491 21203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:49.202637 21203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:49.207294 21203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:49.207521 21203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:49.209144 21203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:49.210531 21203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:49.210637 21203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.210772 21203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:49.210816 21203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.228031 21203 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:40441
I20260806 16:59:49.228269 21339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:40441 every 8 connection(s)
I20260806 16:59:49.229509 21203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:59:49.233636 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21203
I20260806 16:59:49.233790 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 16:59:49.234153 7780 external_mini_cluster.cc:1428] Setting key 964baf8580c9bd816ccfb6f9a1545ca0
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:49.255399 21057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:49.232929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:46207 (local address 127.7.153.62:41669)
0806 16:59:49.233072 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:49.233078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:49.236636 (+ 3558us) server_negotiation.cc:407] Connection header received
0806 16:59:49.238640 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:49.238643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:49.238707 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:49.238816 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:49.241102 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.241914 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.243957 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.244349 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.244489 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:49.249479 (+ 4990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:49.249485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:49.249488 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:49.249531 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:49.251865 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:49.253117 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:49.253122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:49.253124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:49.253283 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:49.253789 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:49.253793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:49.253795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:49.254088 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:49.254209 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:49.255044 (+ 835us) server_negotiation.cc:299] Negotiation successful
0806 16:59:49.255215 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 16:59:49.256520 21342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:49.232675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41669 (local address 127.7.153.3:46207)
0806 16:59:49.236431 (+ 3756us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:49.236499 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:49.238337 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:49.239313 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:49.239324 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:49.239793 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:49.240878 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:49.240905 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.242090 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.242094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:49.243760 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:49.243774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.244559 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.244563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:49.245040 (+ 477us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:49.246257 (+ 1217us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:49.246363 (+ 106us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:49.249112 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:49.252117 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:49.252128 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:49.252162 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:49.252940 (+ 778us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:49.253405 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:49.253409 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:49.253411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:49.253650 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:49.254226 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:49.254234 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:49.254704 (+ 470us) client_negotiation.cc:769] Sending connection context
0806 16:59:49.254939 (+ 235us) client_negotiation.cc:240] Negotiation successful
0806 16:59:49.255337 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3216,"thread_start_us":233,"threads_started":1}
I20260806 16:59:49.258386 21340 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41669
I20260806 16:59:49.258715 21340 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:49.259428 21340 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:49.260926 20830 ts_manager.cc:194] Registered new tserver with Master: af403b7e621e46e6aff52d1dfaf59a13 (127.7.153.3:40441)
I20260806 16:59:49.261772 20830 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:46207
I20260806 16:59:49.262480 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:59:49.263458 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 20914
I20260806 16:59:49.275128 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21062
I20260806 16:59:49.286094 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21203
I20260806 16:59:49.297292 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 20797
I20260806 16:59:49.308487 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41669
--webserver_interface=127.7.153.62
--webserver_port=33765
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:41669
--ranger_config_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:49.437178 21343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:49.437515 21343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:49.437561 21343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:49.442222 21343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:49.442322 21343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:49.442342 21343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:49.442359 21343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:49.442375 21343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:49.449003 21343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:41669
--ranger_config_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=33765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:49.450268 21343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:49.451390 21343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:49.462142 21351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:49.462132 21349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:49.462296 21348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:49.462669 21343 server_base.cc:1034] running on GCE node
I20260806 16:59:49.463523 21343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:49.465000 21343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:49.466236 21343 hybrid_clock.cc:648] HybridClock initialized: now 1786035589466197 us; error 59 us; skew 500 ppm
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:49.470268 21343 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:59:49.471411 21343 webserver.cc:460] Webserver started at http://127.7.153.62:33765/ using document root <none> and password file <none>
I20260806 16:59:49.472048 21343 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:49.472172 21343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:49.515471 21343 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 16:59:49.518741 21361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.520397 21343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260806 16:59:49.520731 21343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "70657d7073514a458654380b5cca993d"
format_stamp: "Formatted at 2026-08-06 16:59:47 on dist-test-slave-cbsf"
server_key: "5af7cbfa663e658c3ee9934e850841a6"
server_key_iv: "1fc44dffe64c10f8c3af8c57f941faf4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:49.521415 21343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:49.539892 21343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:49.543571 21343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:49.543817 21343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:49.553248 21343 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:41669
I20260806 16:59:49.553341 21419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:41669 every 8 connection(s)
I20260806 16:59:49.554590 21343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:59:49.558914 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21343
I20260806 16:59:49.559511 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:37649
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:41669
--webserver_port=39437
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:59:49.559973 21420 sys_catalog.cc:263] Verifying existing consensus state
I20260806 16:59:49.562029 21420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Bootstrap starting.
I20260806 16:59:49.581311 21420 log.cc:824] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:49.588646 21420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 16:59:49.589190 21420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Bootstrap complete.
I20260806 16:59:49.593870 21420 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:49.594359 21420 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70657d7073514a458654380b5cca993d, State: Initialized, Role: FOLLOWER
I20260806 16:59:49.594911 21420 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:49.595073 21420 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:59:49.595165 21420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:59:49.595295 21420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 1 FOLLOWER]: Advancing to term 2
I20260806 16:59:49.597646 21420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:49.598047 21420 leader_election.cc:302] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70657d7073514a458654380b5cca993d; no voters:
I20260806 16:59:49.598423 21420 leader_election.cc:288] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 16:59:49.598588 21424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 2 FOLLOWER]: Leader election won for term 2
I20260806 16:59:49.598867 21424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [term 2 LEADER]: Becoming Leader. State: Replica: 70657d7073514a458654380b5cca993d, State: Running, Role: LEADER
I20260806 16:59:49.599301 21424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } }
I20260806 16:59:49.599781 21420 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:59:49.601014 21425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "70657d7073514a458654380b5cca993d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } } }
I20260806 16:59:49.601166 21425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:49.602393 21426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70657d7073514a458654380b5cca993d. Latest consensus state: current_term: 2 leader_uuid: "70657d7073514a458654380b5cca993d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70657d7073514a458654380b5cca993d" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41669 } } }
I20260806 16:59:49.602499 21426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:49.602756 21420 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 16:59:49.602883 21434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:59:49.610105 21434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:59:49.611006 21434 catalog_manager.cc:1259] Loaded cluster ID: 828f8abc38f24c1c8e0416375124bb23
I20260806 16:59:49.611191 21434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:59:49.614434 21434 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:59:49.615810 21434 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Loaded TSK: 0
I20260806 16:59:49.617619 21434 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 16:59:49.709407 21422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:49.709931 21422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:49.710021 21422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:49.716411 21422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:49.716598 21422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:49.716751 21422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:59:49.725183 21422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:37649
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=39437
--tserver_master_addrs=127.7.153.62:41669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:49.727043 21422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:49.729408 21422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:49.746450 21459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:49.747375 21458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:49.748036 21461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:49.748495 21422 server_base.cc:1034] running on GCE node
I20260806 16:59:49.749208 21422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:49.750519 21422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:49.754031 21422 hybrid_clock.cc:648] HybridClock initialized: now 1786035589753980 us; error 64 us; skew 500 ppm
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:49.759570 21422 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:59:49.761781 21422 webserver.cc:460] Webserver started at http://127.7.153.1:39437/ using document root <none> and password file <none>
I20260806 16:59:49.762705 21422 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:49.762844 21422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:49.791982 21422 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:59:49.795498 21470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.797235 21422 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 16:59:49.797412 21422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "8ba305e7b94d4160b83d689d3586557b"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "e6307b5d269c06cd2cb720a75c012e08"
server_key_iv: "e4a75192140eae5c74222b1db36e156e"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:49.798060 21422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:49.811882 21422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:49.815989 21422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:49.816277 21422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:49.817190 21422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:49.818447 21422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:49.818537 21422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.818614 21422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:49.818652 21422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:49.834535 21422 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:37649
I20260806 16:59:49.836205 21422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:59:49.840525 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21422
I20260806 16:59:49.841140 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:42749
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:41669
--webserver_port=44577
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:59:49.838047 21591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:37649 every 8 connection(s)
Aug 06 16:59:49 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035589, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:49.865934 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:49.840727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41669 (local address 127.7.153.1:32823)
0806 16:59:49.844202 (+ 3475us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:49.844272 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:49.845503 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:49.847219 (+ 1716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:49.847228 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:49.847661 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:49.848376 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:49.848401 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.851159 (+ 2758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.851166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:49.853020 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:49.853042 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.854792 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.854799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:49.855087 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:49.855886 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:49.855918 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:49.857797 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:49.861535 (+ 3738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:49.861544 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:49.861563 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:49.861992 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:49.862492 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:49.862496 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:49.862498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:49.862695 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:49.863600 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:49.863608 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:49.863963 (+ 355us) client_negotiation.cc:769] Sending connection context
0806 16:59:49.864177 (+ 214us) client_negotiation.cc:240] Negotiation successful
0806 16:59:49.864581 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3182,"thread_start_us":183,"threads_started":1}
I20260806 16:59:49.868505 21597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:49.842693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:32823 (local address 127.7.153.62:41669)
0806 16:59:49.845011 (+ 2318us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:49.845036 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:49.845091 (+ 55us) server_negotiation.cc:407] Connection header received
0806 16:59:49.846212 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:49.846229 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:49.846714 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:49.847137 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:49.848632 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.850896 (+ 2264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.853253 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:49.854236 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:49.854465 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:49.858152 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:49.858163 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:49.858190 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:49.858240 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:49.861311 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:49.862177 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:49.862187 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:49.862193 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:49.862376 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:49.862810 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:49.862813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:49.862815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:49.863380 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:49.863535 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:49.866691 (+ 3156us) server_negotiation.cc:299] Negotiation successful
0806 16:59:49.867080 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2140,"thread_start_us":158,"threads_started":1}
I20260806 16:59:49.872745 21592 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41669
I20260806 16:59:49.873050 21592 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:49.873605 21592 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
W20260806 16:59:49.876271 21592 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:41669 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 16:59:49.876425 21592 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:49.876649 21592 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:49.878013 21592 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:49.878262 21592 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
W20260806 16:59:49.879288 21592 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 16:59:50.028939 21596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:50.029296 21596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:50.029383 21596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:50.034263 21596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:50.034370 21596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:50.034479 21596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:59:50.041064 21596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:42749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=44577
--tserver_master_addrs=127.7.153.62:41669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:50.042701 21596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:50.044032 21596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:50.056830 21602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:50.057197 21605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:50.057559 21596 server_base.cc:1034] running on GCE node
W20260806 16:59:50.056740 21603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:50.059686 21596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:50.060495 21596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:50.061782 21596 hybrid_clock.cc:648] HybridClock initialized: now 1786035590061742 us; error 65 us; skew 500 ppm
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:50.065590 21596 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:59:50.067044 21596 webserver.cc:460] Webserver started at http://127.7.153.2:44577/ using document root <none> and password file <none>
I20260806 16:59:50.068334 21596 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:50.068485 21596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:50.091406 21596 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 16:59:50.097280 21613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:50.098968 21596 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260806 16:59:50.099172 21596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "a732d2b88a234587a7b81629ef052d46"
format_stamp: "Formatted at 2026-08-06 16:59:48 on dist-test-slave-cbsf"
server_key: "891168005fcb64a0bafa021443085827"
server_key_iv: "bd676b257016e8d00b5b7d48d1096aac"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:50.100054 21596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:50.139045 21596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:50.143605 21596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:50.144013 21596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:50.144906 21596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:50.146181 21596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:50.146268 21596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:50.146371 21596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:50.146425 21596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:50.159189 21596 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:42749
I20260806 16:59:50.159219 21730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:42749 every 8 connection(s)
I20260806 16:59:50.160482 21596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:59:50.168056 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21596
I20260806 16:59:50.168601 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.153.20:60415/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:40441
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:41669
--webserver_port=37531
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:44797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:50.175697 21597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:50.162772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:54207 (local address 127.7.153.62:41669)
0806 16:59:50.162918 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:50.162922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:50.163974 (+ 1052us) server_negotiation.cc:407] Connection header received
0806 16:59:50.165168 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:50.165171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:50.165241 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:50.165323 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:50.166523 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.167146 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.168478 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.168827 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.168932 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:50.171622 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:50.171625 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:50.171627 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:50.171658 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:50.173267 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:50.173879 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:50.173883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:50.173885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:50.173981 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:50.174385 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:50.174390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:50.174392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:50.174605 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:50.174712 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:50.175376 (+ 664us) server_negotiation.cc:299] Negotiation successful
0806 16:59:50.175525 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:59:50.176910 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:50.163250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41669 (local address 127.7.153.2:54207)
0806 16:59:50.163794 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:50.163852 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:50.164919 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:50.165512 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:50.165520 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:50.165819 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:50.166350 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:50.166365 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.167284 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.167287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:50.168338 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:50.168349 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.169117 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.169120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:50.169278 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:50.169955 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:50.169974 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:50.171401 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:50.173416 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:50.173424 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:50.173446 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:50.173758 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:50.174089 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:50.174092 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:50.174094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:50.174282 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:50.174728 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:50.174737 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:50.175114 (+ 377us) client_negotiation.cc:769] Sending connection context
0806 16:59:50.175336 (+ 222us) client_negotiation.cc:240] Negotiation successful
0806 16:59:50.175711 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":174,"threads_started":1}
I20260806 16:59:50.178741 21731 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41669
I20260806 16:59:50.179045 21731 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.179702 21731 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
W20260806 16:59:50.181867 21731 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:41669 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 16:59:50.182018 21731 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.182247 21731 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:50.183444 21731 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.183672 21731 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
W20260806 16:59:50.184675 21731 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 16:59:50.341823 21734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:50.342360 21734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:50.342505 21734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:50.349102 21734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:50.349220 21734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:50.349342 21734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:59:50.357214 21734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.153.20:60415/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:40441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=37531
--tserver_master_addrs=127.7.153.62:41669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:50.358655 21734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:50.359894 21734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:50.376010 21741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:50.376168 21740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:50.376013 21744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:50.376610 21734 server_base.cc:1034] running on GCE node
I20260806 16:59:50.377205 21734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:50.378104 21734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:50.379537 21734 hybrid_clock.cc:648] HybridClock initialized: now 1786035590379476 us; error 59 us; skew 500 ppm
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:50.383306 21734 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 16:59:50.384562 21734 webserver.cc:460] Webserver started at http://127.7.153.3:37531/ using document root <none> and password file <none>
I20260806 16:59:50.385941 21734 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:50.386124 21734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:50.416944 21734 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 16:59:50.420472 21752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:50.422483 21734 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 16:59:50.422780 21734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "af403b7e621e46e6aff52d1dfaf59a13"
format_stamp: "Formatted at 2026-08-06 16:59:49 on dist-test-slave-cbsf"
server_key: "bc6185afaae397ab46e59cd38b7e768a"
server_key_iv: "b84dcb805ad5d5412be7a88afa9c9ec4"
server_key_version: "kuduclusterkey@0"
I20260806 16:59:50.423667 21734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:50.439330 21734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:50.443359 21734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:50.443620 21734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:50.444531 21734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:50.445859 21734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:50.445998 21734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 16:59:50.446125 21734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:50.446189 21734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:50.463541 21734 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:40441
I20260806 16:59:50.463693 21869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:40441 every 8 connection(s)
I20260806 16:59:50.466146 21734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 16:59:50.472184 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21734
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:50.482717 21874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:50.473063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58360 (local address 127.7.153.62:41669)
0806 16:59:50.473673 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:50.473676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:50.473688 (+ 12us) server_negotiation.cc:407] Connection header received
0806 16:59:50.473726 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:50.473728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:50.473767 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:50.473881 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:50.474684 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.475197 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.476166 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.476418 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.476551 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:50.478481 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:50.478485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:50.478487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:50.478513 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:50.480146 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:50.480661 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:50.480671 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:50.480673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:50.480859 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:50.481217 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:50.481224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:50.481226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:50.481528 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:50.481775 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:50.482140 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 16:59:50.482325 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":86,"threads_started":1}
I20260806 16:59:50.485791 21597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:50.468813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:35897 (local address 127.7.153.62:41669)
0806 16:59:50.468974 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:50.468979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:50.470226 (+ 1247us) server_negotiation.cc:407] Connection header received
0806 16:59:50.471592 (+ 1366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:50.471596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:50.471653 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:50.471743 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:50.473995 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.474863 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.476809 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.477183 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.477265 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:50.480535 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:50.480539 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:50.480542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:50.480572 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:50.482389 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:50.483191 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:50.483195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:50.483196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:50.483297 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:50.483815 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:50.483819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:50.483821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:50.484073 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:50.484168 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:50.485481 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0806 16:59:50.485656 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 16:59:50.487085 21872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:50.469330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41669 (local address 127.7.153.3:35897)
0806 16:59:50.469975 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:50.470062 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:50.471280 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:50.471984 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:50.471995 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:50.472444 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:50.473769 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:50.473797 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.475067 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.475070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:50.476604 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:50.476618 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:50.477513 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:50.477518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:50.477895 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:50.478552 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:50.478577 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:50.480257 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:50.482555 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:50.482563 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:50.482590 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:50.483027 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:50.483434 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:50.483437 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:50.483439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:50.483682 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:50.484252 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:50.484261 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:50.485102 (+ 841us) client_negotiation.cc:769] Sending connection context
0806 16:59:50.485385 (+ 283us) client_negotiation.cc:240] Negotiation successful
0806 16:59:50.485810 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":156,"threads_started":1}
I20260806 16:59:50.488962 21870 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41669
I20260806 16:59:50.489308 21870 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.490417 21870 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
W20260806 16:59:50.492655 21870 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:41669 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 16:59:50.493022 21870 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.493316 21870 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:50.494410 21870 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.494690 21870 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
W20260806 16:59:50.496240 21870 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 16:59:50.879547 21592 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:50.879881 21592 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:50.881229 21378 ts_manager.cc:194] Registered new tserver with Master: 8ba305e7b94d4160b83d689d3586557b (127.7.153.1:37649)
I20260806 16:59:50.883008 21378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:32823
Aug 06 16:59:50 dist-test-slave-cbsf krb5kdc[20326](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:51.184998 21731 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:51.185384 21731 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:51.186513 21378 ts_manager.cc:194] Registered new tserver with Master: a732d2b88a234587a7b81629ef052d46 (127.7.153.2:42749)
I20260806 16:59:51.187424 21378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:54207
Aug 06 16:59:51 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:51.496860 21870 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:51.497263 21870 heartbeater.cc:511] Master 127.7.153.62:41669 requested a full tablet report, sending...
I20260806 16:59:51.498303 21378 ts_manager.cc:194] Registered new tserver with Master: af403b7e621e46e6aff52d1dfaf59a13 (127.7.153.3:40441)
I20260806 16:59:51.499155 21378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:35897
I20260806 16:59:51.504516 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 16:59:51.519024 21892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.506490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58368 (local address 127.7.153.62:41669)
0806 16:59:51.506988 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.506993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.507264 (+ 271us) server_negotiation.cc:407] Connection header received
0806 16:59:51.507389 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.507393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.507448 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.507550 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:51.508490 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.509402 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.510766 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.511266 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.511446 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.514031 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:51.514037 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:51.514040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:51.514091 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:51.516260 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:51.516969 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:51.516973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:51.516975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:51.517084 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:51.517452 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:51.517456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:51.517458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:51.517745 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:51.517883 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.518663 (+ 780us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.518820 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":144,"threads_started":1}
I20260806 16:59:51.524755 21378 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 16:59:51.530313 21378 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 16:59:51.557512 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.546528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51706 (local address 127.7.153.3:40441)
0806 16:59:51.546977 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.546987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.549119 (+ 2132us) server_negotiation.cc:407] Connection header received
0806 16:59:51.549378 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.549384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.549611 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.549744 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:59:51.550208 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.552425 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.554296 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.555198 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.555297 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.555479 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.557198 (+ 1719us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.557343 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":62,"threads_started":1}
I20260806 16:59:51.558401 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.546313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:40441 (local address 127.0.0.1:51706)
0806 16:59:51.548949 (+ 2636us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:51.548966 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:51.549204 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:51.549956 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:51.549959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:51.549978 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:59:51.550070 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.550076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.552586 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.552602 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.554131 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.554144 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.556750 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.556753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.556895 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.556954 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 16:59:51.558047 (+ 1093us) client_negotiation.cc:240] Negotiation successful
0806 16:59:51.558235 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2568,"thread_start_us":145,"threads_started":1}
I20260806 16:59:51.562913 21800 tablet_service.cc:1467] Processing CreateTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 (DEFAULT_TABLE table=test-table [id=d13e896f35774fbfa603f4d67a375d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:59:51.567292 21800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b7841b8969d49a097ff2dfffce41c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:51.570020 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.545774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42749 (local address 127.0.0.1:40772)
0806 16:59:51.547838 (+ 2064us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:51.547856 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:51.547971 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:51.550473 (+ 2502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:51.550477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:51.550494 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:59:51.550574 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.550580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.565663 (+ 15083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.565666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.566868 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.566882 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.569550 (+ 2668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.569554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.569657 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.569683 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 16:59:51.569761 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 16:59:51.569847 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1982,"thread_start_us":146,"threads_started":1}
I20260806 16:59:51.571019 21900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.543692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37649 (local address 127.0.0.1:52720)
0806 16:59:51.547327 (+ 3635us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:51.547396 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:51.547553 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:51.549364 (+ 1811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:51.549371 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:51.549398 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:59:51.549557 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.549565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.564070 (+ 14505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.564075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.565368 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.565391 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.570620 (+ 5229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.570624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.570717 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.570744 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:59:51.570794 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 16:59:51.570873 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3392,"thread_start_us":147,"threads_started":1}
I20260806 16:59:51.575244 21899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.543817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52720 (local address 127.7.153.1:37649)
0806 16:59:51.548286 (+ 4469us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.548296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.548331 (+ 35us) server_negotiation.cc:407] Connection header received
0806 16:59:51.548427 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.548433 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.548689 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.548883 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:59:51.550731 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.551817 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.567117 (+ 15300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.568088 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.574661 (+ 6573us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.574876 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.574949 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.575085 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4318,"thread_start_us":100,"threads_started":1}
I20260806 16:59:51.575887 21901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.546188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40772 (local address 127.7.153.2:42749)
0806 16:59:51.549865 (+ 3677us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.549872 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.549896 (+ 24us) server_negotiation.cc:407] Connection header received
0806 16:59:51.549983 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.549987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.550157 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.550293 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:59:51.551975 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.553105 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.568255 (+ 15150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.569173 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.569300 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.569464 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.575594 (+ 6130us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.575745 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3544,"thread_start_us":169,"threads_started":1}
I20260806 16:59:51.579595 21521 tablet_service.cc:1467] Processing CreateTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 (DEFAULT_TABLE table=test-table [id=d13e896f35774fbfa603f4d67a375d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:59:51.579595 21654 tablet_service.cc:1467] Processing CreateTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 (DEFAULT_TABLE table=test-table [id=d13e896f35774fbfa603f4d67a375d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 16:59:51.580952 21521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b7841b8969d49a097ff2dfffce41c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:51.580952 21654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b7841b8969d49a097ff2dfffce41c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:51.598088 21905 tablet_bootstrap.cc:492] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Bootstrap starting.
I20260806 16:59:51.599709 21904 tablet_bootstrap.cc:492] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Bootstrap starting.
I20260806 16:59:51.602044 21906 tablet_bootstrap.cc:492] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b: Bootstrap starting.
I20260806 16:59:51.605188 21906 tablet_bootstrap.cc:654] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:51.607189 21905 tablet_bootstrap.cc:654] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:51.607167 21906 log.cc:824] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:51.608494 21905 log.cc:824] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:51.609115 21904 tablet_bootstrap.cc:654] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:51.610203 21904 log.cc:824] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:51.610764 21906 tablet_bootstrap.cc:492] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b: No bootstrap required, opened a new log
I20260806 16:59:51.611016 21906 ts_tablet_manager.cc:1397] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 16:59:51.615626 21906 raft_consensus.cc:348] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.616011 21906 raft_consensus.cc:374] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:51.615927 21905 tablet_bootstrap.cc:492] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: No bootstrap required, opened a new log
I20260806 16:59:51.616102 21906 raft_consensus.cc:729] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba305e7b94d4160b83d689d3586557b, State: Initialized, Role: FOLLOWER
I20260806 16:59:51.616405 21905 ts_tablet_manager.cc:1397] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.000s
I20260806 16:59:51.616671 21906 consensus_queue.cc:260] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.618222 21906 ts_tablet_manager.cc:1428] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b: Time spent starting tablet: real 0.007s user 0.003s sys 0.005s
I20260806 16:59:51.618701 21592 heartbeater.cc:503] Master 127.7.153.62:41669 was elected leader, sending a full tablet report...
I20260806 16:59:51.621930 21905 raft_consensus.cc:348] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.622639 21905 raft_consensus.cc:374] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:51.622761 21905 raft_consensus.cc:729] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af403b7e621e46e6aff52d1dfaf59a13, State: Initialized, Role: FOLLOWER
I20260806 16:59:51.623406 21905 consensus_queue.cc:260] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.624327 21904 tablet_bootstrap.cc:492] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: No bootstrap required, opened a new log
I20260806 16:59:51.624583 21904 ts_tablet_manager.cc:1397] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.000s
I20260806 16:59:51.626242 21905 ts_tablet_manager.cc:1428] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260806 16:59:51.628125 21870 heartbeater.cc:503] Master 127.7.153.62:41669 was elected leader, sending a full tablet report...
I20260806 16:59:51.631036 21904 raft_consensus.cc:348] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.631428 21904 raft_consensus.cc:374] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:51.631508 21904 raft_consensus.cc:729] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a732d2b88a234587a7b81629ef052d46, State: Initialized, Role: FOLLOWER
I20260806 16:59:51.632068 21904 consensus_queue.cc:260] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.633373 21904 ts_tablet_manager.cc:1428] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260806 16:59:51.633827 21731 heartbeater.cc:503] Master 127.7.153.62:41669 was elected leader, sending a full tablet report...
W20260806 16:59:51.663972 21732 tablet.cc:2369] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 16:59:51 dist-test-slave-cbsf krb5kdc[20326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035590, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for HTTP/127.7.153.20@KRBTEST.COM
I20260806 16:59:51.698957 21910 raft_consensus.cc:482] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:59:51.699229 21910 raft_consensus.cc:504] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.700795 21910 leader_election.cc:288] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af403b7e621e46e6aff52d1dfaf59a13 (127.7.153.3:40441), a732d2b88a234587a7b81629ef052d46 (127.7.153.2:42749)
I20260806 16:59:51.709791 21901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.701619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:51213 (local address 127.7.153.2:42749)
0806 16:59:51.701772 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.701777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.704970 (+ 3193us) server_negotiation.cc:407] Connection header received
0806 16:59:51.705258 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.705261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.705319 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.705371 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:59:51.705860 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.706661 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.708437 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.709101 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.709207 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.709283 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.709544 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.709635 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 16:59:51.710559 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.701123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:42749 (local address 127.7.153.1:51213)
0806 16:59:51.704831 (+ 3708us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:51.704853 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:51.705102 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:51.705525 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:51.705527 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:51.705546 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:59:51.705706 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.705714 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.706836 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.706839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.708257 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.708273 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.709276 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.709280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.709383 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.709410 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 16:59:51.710297 (+ 887us) client_negotiation.cc:240] Negotiation successful
0806 16:59:51.710394 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3582,"thread_start_us":1023,"threads_started":1}
I20260806 16:59:51.711890 21683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b7841b8969d49a097ff2dfffce41c53" candidate_uuid: "8ba305e7b94d4160b83d689d3586557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a732d2b88a234587a7b81629ef052d46" is_pre_election: true
I20260806 16:59:51.712284 21683 raft_consensus.cc:2454] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba305e7b94d4160b83d689d3586557b in term 0.
I20260806 16:59:51.713032 21471 leader_election.cc:302] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ba305e7b94d4160b83d689d3586557b, a732d2b88a234587a7b81629ef052d46; no voters:
I20260806 16:59:51.713346 21910 raft_consensus.cc:2781] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:59:51.713440 21910 raft_consensus.cc:482] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:59:51.713485 21910 raft_consensus.cc:3037] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:51.715144 21910 raft_consensus.cc:504] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.715638 21910 leader_election.cc:288] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [CANDIDATE]: Term 1 election: Requested vote from peers af403b7e621e46e6aff52d1dfaf59a13 (127.7.153.3:40441), a732d2b88a234587a7b81629ef052d46 (127.7.153.2:42749)
I20260806 16:59:51.717123 21683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b7841b8969d49a097ff2dfffce41c53" candidate_uuid: "8ba305e7b94d4160b83d689d3586557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a732d2b88a234587a7b81629ef052d46"
I20260806 16:59:51.717295 21683 raft_consensus.cc:3037] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 0 FOLLOWER]: Advancing to term 1
W20260806 16:59:51.718417 21871 tablet.cc:2369] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 16:59:51.718787 21683 raft_consensus.cc:2454] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ba305e7b94d4160b83d689d3586557b in term 1.
I20260806 16:59:51.719833 21471 leader_election.cc:302] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ba305e7b94d4160b83d689d3586557b, a732d2b88a234587a7b81629ef052d46; no voters:
I20260806 16:59:51.720213 21910 raft_consensus.cc:2781] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:59:51.720463 21910 raft_consensus.cc:686] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [term 1 LEADER]: Becoming Leader. State: Replica: 8ba305e7b94d4160b83d689d3586557b, State: Running, Role: LEADER
I20260806 16:59:51.721535 21910 consensus_queue.cc:237] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } }
I20260806 16:59:51.727643 21378 catalog_manager.cc:5495] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ba305e7b94d4160b83d689d3586557b (127.7.153.1). New cstate: current_term: 1 leader_uuid: "8ba305e7b94d4160b83d689d3586557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ba305e7b94d4160b83d689d3586557b" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 37649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20260806 16:59:51.734321 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.701809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:36905 (local address 127.7.153.3:40441)
0806 16:59:51.701966 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.701971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.708795 (+ 6824us) server_negotiation.cc:407] Connection header received
0806 16:59:51.709004 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.709008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.709076 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.709130 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 16:59:51.711835 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.712561 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.732220 (+ 19659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.732964 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.733106 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.733183 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.734059 (+ 876us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.734174 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 16:59:51.734862 21915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.701218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:40441 (local address 127.7.153.1:36905)
0806 16:59:51.708669 (+ 7451us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:51.708686 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:51.708883 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:51.711505 (+ 2622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:51.711508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:51.711535 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 16:59:51.711669 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.711676 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.712746 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.712749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.731787 (+ 19038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:51.731812 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.733732 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.733737 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:51.733879 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.733913 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 16:59:51.734579 (+ 666us) client_negotiation.cc:240] Negotiation successful
0806 16:59:51.734683 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7356,"thread_start_us":936,"threads_started":1}
I20260806 16:59:51.735957 21821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b7841b8969d49a097ff2dfffce41c53" candidate_uuid: "8ba305e7b94d4160b83d689d3586557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af403b7e621e46e6aff52d1dfaf59a13" is_pre_election: true
I20260806 16:59:51.736127 21820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b7841b8969d49a097ff2dfffce41c53" candidate_uuid: "8ba305e7b94d4160b83d689d3586557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af403b7e621e46e6aff52d1dfaf59a13"
I20260806 16:59:51.736317 21821 raft_consensus.cc:2454] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ba305e7b94d4160b83d689d3586557b in term 0.
I20260806 16:59:51.769172 21899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.763543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52724 (local address 127.7.153.1:37649)
0806 16:59:51.763679 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:51.763684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:51.763698 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:59:51.763799 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:51.763802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:51.763877 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:51.763997 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 16:59:51.764452 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.765266 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.766370 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:51.766693 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:51.766827 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:51.767227 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 16:59:51.768210 (+ 983us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 16:59:51.768351 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:51.768916 (+ 565us) server_negotiation.cc:299] Negotiation successful
0806 16:59:51.768991 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 16:59:51.778789 21683 raft_consensus.cc:1261] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 1 FOLLOWER]: Refusing update from remote peer 8ba305e7b94d4160b83d689d3586557b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:59:51.779780 21917 consensus_queue.cc:1035] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a732d2b88a234587a7b81629ef052d46" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:59:51.787829 21922 mvcc.cc:205] Tried to move back new op lower bound from 7315601783912628224 to 7315601783698522112. Current Snapshot: MvccSnapshot[applied={T|T < 7315601783912628224}]
I20260806 16:59:51.789855 21821 raft_consensus.cc:3037] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:51.791641 21821 raft_consensus.cc:1261] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 1 FOLLOWER]: Refusing update from remote peer 8ba305e7b94d4160b83d689d3586557b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:59:51.792306 21910 consensus_queue.cc:1035] T 7b7841b8969d49a097ff2dfffce41c53 P 8ba305e7b94d4160b83d689d3586557b [LEADER]: Connected to new peer: Peer: permanent_uuid: "af403b7e621e46e6aff52d1dfaf59a13" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 40441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:59:51.796236 21923 mvcc.cc:205] Tried to move back new op lower bound from 7315601783912628224 to 7315601783698522112. Current Snapshot: MvccSnapshot[applied={T|T < 7315601783912628224}]
I20260806 16:59:51.803542 21378 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:59:51.803771 21378 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 16:59:51.807422 21929 mvcc.cc:205] Tried to move back new op lower bound from 7315601783912628224 to 7315601783698522112. Current Snapshot: MvccSnapshot[applied={T|T < 7315601783912628224}]
I20260806 16:59:51.808495 21378 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70657d7073514a458654380b5cca993d: Sending DeleteTablet for 3 replicas of tablet 7b7841b8969d49a097ff2dfffce41c53
I20260806 16:59:51.810592 21800 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:59:51 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:51706
I20260806 16:59:51.812007 21932 tablet_replica.cc:330] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: stopping tablet replica
I20260806 16:59:51.812402 21932 raft_consensus.cc:2229] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:59:51.813279 21932 raft_consensus.cc:2258] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:59:51.814281 21654 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:59:51 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40772
I20260806 16:59:51.818675 21521 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:59:51 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:52720
I20260806 16:59:51.819567 21800 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b7841b8969d49a097ff2dfffce41c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 16:59:51 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:51706
I20260806 16:59:51.820271 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21422
I20260806 16:59:51.820442 21933 tablet_replica.cc:330] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: stopping tablet replica
I20260806 16:59:51.822404 21932 ts_tablet_manager.cc:1905] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:59:51.824416 21933 raft_consensus.cc:2229] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 16:59:51.824954 21933 raft_consensus.cc:2258] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 16:59:51.826013 21932 ts_tablet_manager.cc:1918] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:59:51.826148 21932 log.cc:1196] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/7b7841b8969d49a097ff2dfffce41c53
I20260806 16:59:51.826541 21932 ts_tablet_manager.cc:1939] T 7b7841b8969d49a097ff2dfffce41c53 P af403b7e621e46e6aff52d1dfaf59a13: Deleting consensus metadata
I20260806 16:59:51.827364 21933 ts_tablet_manager.cc:1905] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 16:59:51.828075 21364 catalog_manager.cc:4841] TS af403b7e621e46e6aff52d1dfaf59a13 (127.7.153.3:40441): tablet 7b7841b8969d49a097ff2dfffce41c53 (table test-table [id=d13e896f35774fbfa603f4d67a375d25]) successfully deleted
W20260806 16:59:51.828653 21364 catalog_manager.cc:4808] TS af403b7e621e46e6aff52d1dfaf59a13 (127.7.153.3:40441): delete failed for tablet 7b7841b8969d49a097ff2dfffce41c53 because the tablet was not found. No further retry: Not found: Tablet not found: 7b7841b8969d49a097ff2dfffce41c53
I20260806 16:59:51.832027 21933 ts_tablet_manager.cc:1918] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 16:59:51.832271 21933 log.cc:1196] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/7b7841b8969d49a097ff2dfffce41c53
I20260806 16:59:51.833263 21933 ts_tablet_manager.cc:1939] T 7b7841b8969d49a097ff2dfffce41c53 P a732d2b88a234587a7b81629ef052d46: Deleting consensus metadata
I20260806 16:59:51.835179 21362 catalog_manager.cc:4841] TS a732d2b88a234587a7b81629ef052d46 (127.7.153.2:42749): tablet 7b7841b8969d49a097ff2dfffce41c53 (table test-table [id=d13e896f35774fbfa603f4d67a375d25]) successfully deleted
W20260806 16:59:51.851253 21364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:37649 (error 108)
I20260806 16:59:51.853477 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:51.853085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:37649 (local address 127.0.0.1:52730)
0806 16:59:51.853294 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:51.853367 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:37649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260806 16:59:51.854373 21364 catalog_manager.cc:4584] TS 8ba305e7b94d4160b83d689d3586557b (127.7.153.1:37649): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b7841b8969d49a097ff2dfffce41c53: Network error: Client connection negotiation failed: client connection to 127.7.153.1:37649: connect: Connection refused (error 111)
I20260806 16:59:51.854923 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21596
I20260806 16:59:51.869226 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21734
I20260806 16:59:51.879968 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21343
I20260806 16:59:51.891266 7780 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 16:59:52.237989 7780 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 16:59:52.238174 7780 mini_ranger.cc:66] Stopping Ranger...
I20260806 16:59:52.584636 7780 mini_ranger.cc:68] Stopped Ranger
2026-08-06 16:59:52.584 UTC [20360] LOG: received smart shutdown request
2026-08-06 16:59:52.589 UTC [20360] LOG: background worker "logical replication launcher" (PID 20369) exited with exit code 1
2026-08-06 16:59:52.590 UTC [20364] LOG: shutting down
2026-08-06 16:59:52.775 UTC [20360] LOG: database system is shut down
2026-08-06T16:59:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55394 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:59:52 dist-test-slave-cbsf krb5kdc[21944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:59:52 dist-test-slave-cbsf krb5kdc[21944](info): set up 2 sockets
Aug 06 16:59:52 dist-test-slave-cbsf krb5kdc[21944](info): commencing operation
krb5kdc: starting...
W20260806 16:59:53.995122 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:59:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:59:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:59:54.142352 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42771
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42771,127.7.153.61:37055,127.7.153.60:38109
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:54.268635 21958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:54.269033 21958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:54.269079 21958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:54.273469 21958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:54.273551 21958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:54.273571 21958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:54.273594 21958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:54.273663 21958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:54.279601 21958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42771,127.7.153.61:37055,127.7.153.60:38109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:54.280969 21958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:54.282172 21958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:54.291961 21966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:54.292024 21963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:54.291926 21964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:54.292470 21958 server_base.cc:1034] running on GCE node
I20260806 16:59:54.293236 21958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:54.294461 21958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:54.295672 21958 hybrid_clock.cc:648] HybridClock initialized: now 1786035594295651 us; error 37 us; skew 500 ppm
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:54.299053 21958 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:59:54.300806 21958 webserver.cc:460] Webserver started at http://127.7.153.62:34067/ using document root <none> and password file <none>
I20260806 16:59:54.301496 21958 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:54.301570 21958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:54.301784 21958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:54.304153 21958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "8e71dd62604846a2b9c62b2e3fec6087"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "72721f96762e93797bac34e6ec4e3fc5"
server_key_iv: "b5bd939c0cf518bef15b28f155859757"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.304893 21958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "8e71dd62604846a2b9c62b2e3fec6087"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "72721f96762e93797bac34e6ec4e3fc5"
server_key_iv: "b5bd939c0cf518bef15b28f155859757"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.309418 21958 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:59:54.312424 21976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:54.313948 21958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:59:54.314111 21958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "8e71dd62604846a2b9c62b2e3fec6087"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "72721f96762e93797bac34e6ec4e3fc5"
server_key_iv: "b5bd939c0cf518bef15b28f155859757"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.314242 21958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:54.332099 21958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:54.335880 21958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:54.336140 21958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:54.345340 21958 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42771
I20260806 16:59:54.345362 22029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42771 every 8 connection(s)
I20260806 16:59:54.346627 21958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:59:54.350088 22031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:54.352013 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 21958
I20260806 16:59:54.352169 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:59:54.352524 7780 external_mini_cluster.cc:1428] Setting key 585835bc5c04b95351861eccc66415ef
I20260806 16:59:54.356067 22031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.153.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.61@KRBTEST.COM" created.
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:54.376427 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.359310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36820 (local address 127.7.153.62:42771)
0806 16:59:54.359978 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.359997 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.360217 (+ 220us) server_negotiation.cc:407] Connection header received
0806 16:59:54.361873 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.361878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.362092 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.362312 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.363283 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.364298 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.365797 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.366470 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.366717 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.369804 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.369812 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.369827 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.369852 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.372239 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.373277 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.373285 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.373286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.373435 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.373925 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.373928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.373930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.374426 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.374553 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.375140 (+ 587us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.375430 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":534,"spinlock_wait_cycles":42368,"thread_start_us":200,"threads_started":1}
I20260806 16:59:54.376430 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.359310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42771 (local address 127.0.0.1:36820)
0806 16:59:54.359999 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.360077 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.361464 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.362352 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.362361 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.362817 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.363102 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.363116 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.364455 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.364458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.365646 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.365659 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.366664 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.366667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.366773 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.367507 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.367527 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.369563 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.372525 (+ 2962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.372547 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.372568 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.373105 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.373562 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.373568 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.373573 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.373765 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.374579 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.374591 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.374814 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.375045 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.375531 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":88,"thread_start_us":180,"threads_started":1}
I20260806 16:59:54.379482 22031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } has no permanent_uuid. Determining permanent_uuid...
I20260806 16:59:54.380398 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.380052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60800)
0806 16:59:54.380232 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.380315 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260806 16:59:54.380793 21979 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
I20260806 16:59:54.382263 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.381992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60802)
0806 16:59:54.382126 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.382189 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 16:59:54.382445 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:37055: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab.
Entry for principal kudu/127.7.153.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab.
I20260806 16:59:54.386349 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:37055
--webserver_interface=127.7.153.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab
--principal=kudu/127.7.153.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42771,127.7.153.61:37055,127.7.153.60:38109
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:59:54.431810 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } attempt: 1
I20260806 16:59:54.432942 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.432570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60812)
0806 16:59:54.432789 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.432854 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 16:59:54.433725 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.433495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60816)
0806 16:59:54.433611 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.433667 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 16:59:54.433857 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:37055: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
I20260806 16:59:54.502061 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } attempt: 2
I20260806 16:59:54.503003 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.502689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60820)
0806 16:59:54.502850 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.502919 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 16:59:54.504073 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.503556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60828)
0806 16:59:54.503817 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.503928 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260806 16:59:54.504365 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:37055: Network error: Client connection negotiation failed: client connection to 127.7.153.61:37055: connect: Connection refused (error 111)
W20260806 16:59:54.515496 22038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:54.515836 22038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:54.515880 22038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:54.520540 22038 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:54.520635 22038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:54.520656 22038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:54.520674 22038 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:54.520741 22038 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:54.526779 22038 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42771,127.7.153.61:37055,127.7.153.60:38109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab
--principal=kudu/127.7.153.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:37055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.153.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:54.528075 22038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:54.529233 22038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:54.538749 22046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:54.538738 22044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:54.538738 22043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:54.538858 22038 server_base.cc:1034] running on GCE node
I20260806 16:59:54.539669 22038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:54.541018 22038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:54.542236 22038 hybrid_clock.cc:648] HybridClock initialized: now 1786035594542211 us; error 41 us; skew 500 ppm
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:54.545940 22038 init.cc:377] Logged in from keytab as kudu/127.7.153.61@KRBTEST.COM (short username kudu)
I20260806 16:59:54.547513 22038 webserver.cc:460] Webserver started at http://127.7.153.61:38589/ using document root <none> and password file <none>
I20260806 16:59:54.548765 22038 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:54.548902 22038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:54.549208 22038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:54.551533 22038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data/instance:
uuid: "a0f6c80a473848f0bd09b69b5e632b4b"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "d46ad824885bc81ad6278cf20ce3a36b"
server_key_iv: "eb11c2900e08abd52a816d086da04f1a"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.552167 22038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal/instance:
uuid: "a0f6c80a473848f0bd09b69b5e632b4b"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "d46ad824885bc81ad6278cf20ce3a36b"
server_key_iv: "eb11c2900e08abd52a816d086da04f1a"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.556249 22038 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 16:59:54.559201 22053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:54.560657 22038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:59:54.560892 22038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal
uuid: "a0f6c80a473848f0bd09b69b5e632b4b"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "d46ad824885bc81ad6278cf20ce3a36b"
server_key_iv: "eb11c2900e08abd52a816d086da04f1a"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.561028 22038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:54.578189 22038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:54.581971 22038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:54.582208 22038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:54.590083 22038 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.61:37055
I20260806 16:59:54.590113 22111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.61:37055 every 8 connection(s)
I20260806 16:59:54.591137 22038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
I20260806 16:59:54.594565 22112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:54.595551 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22038
I20260806 16:59:54.595544 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } attempt: 3
I20260806 16:59:54.595695 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-1/wal/instance
I20260806 16:59:54.595997 7780 external_mini_cluster.cc:1428] Setting key fe40f20ea271e230fc0da6d826c98941
I20260806 16:59:54.600814 22112 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.60@KRBTEST.COM" created.
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:54.610852 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.596162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60838)
0806 16:59:54.596383 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.596405 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.596486 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.599905 (+ 3419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.599909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.600134 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.600281 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.600290 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.601772 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.601778 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.602442 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.602453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.603383 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.603387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.603529 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.604162 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.604185 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.605974 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.608470 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.608475 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.608477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.608772 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.609253 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.609256 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.609258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.609355 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.610248 (+ 893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.610251 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.610362 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.610489 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.610669 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260806 16:59:54.612025 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.597311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60838 (local address 127.7.153.61:37055)
0806 16:59:54.597796 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.597818 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.597861 (+ 43us) server_negotiation.cc:407] Connection header received
0806 16:59:54.598965 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.598995 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.599525 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.599968 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.600455 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.601635 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.602576 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.603235 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.604402 (+ 1167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.606234 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.606241 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.606255 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.606291 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.608346 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.608906 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.608912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.608918 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.609140 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.609461 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.609465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.609467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.610140 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.610284 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.610669 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.611013 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":169,"threads_started":1}
I20260806 16:59:54.614319 22031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } has no permanent_uuid. Determining permanent_uuid...
I20260806 16:59:54.614647 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.603286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42771 (local address 127.0.0.1:36826)
0806 16:59:54.603877 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.603942 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.604174 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.604626 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.604632 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.605083 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.605229 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.605235 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.606067 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.606070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.606870 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.606886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.608283 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.608287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.608420 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.608970 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.608984 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.610763 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.612911 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.612921 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.612927 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.613163 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.613460 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.613464 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.613466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.613550 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.613970 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.613978 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.614099 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.614268 (+ 169us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.614467 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":193,"threads_started":1}
I20260806 16:59:54.615123 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.614882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49924)
0806 16:59:54.614998 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.615052 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 16:59:54.615374 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.603376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36826 (local address 127.7.153.62:42771)
0806 16:59:54.603549 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.603556 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.604046 (+ 490us) server_negotiation.cc:407] Connection header received
0806 16:59:54.604309 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.604312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.604363 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.604451 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.605359 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.605944 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.607022 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.607996 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.608278 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.610933 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.610940 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.610946 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.610978 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.612796 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.613275 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.613280 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.613282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.613365 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.613659 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.613663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.613664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.613860 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.613969 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.615082 (+ 1113us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.615227 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 16:59:54.615760 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.615524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49928)
0806 16:59:54.615662 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.615715 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 16:59:54.615919 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
I20260806 16:59:54.616425 22112 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 16:59:54.625931 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.616961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60854)
0806 16:59:54.617053 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.617069 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.617175 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.617414 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.617417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.617565 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.617650 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.617655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.618772 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.618774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.619409 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.619418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.620092 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.620095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.620170 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.620761 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.620781 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.622338 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.624235 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.624237 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.624239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.624497 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.624855 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.624858 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.624859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.624946 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.625405 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.625407 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.625493 (+ 86us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.625581 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.625776 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 16:59:54.625962 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.617031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60854 (local address 127.7.153.61:37055)
0806 16:59:54.617181 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.617188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.617207 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:59:54.617248 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.617253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.617307 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.617395 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.617772 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.618659 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.619508 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.619967 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.620104 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.622501 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.622509 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.622512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.622539 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.624088 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.624590 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.624592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.624594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.624674 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.625055 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.625060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.625064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.625313 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.625397 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.625666 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.625838 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":48}
I20260806 16:59:54.627331 22112 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } has no permanent_uuid. Determining permanent_uuid...
I20260806 16:59:54.628175 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.627845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49938)
0806 16:59:54.628015 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.628101 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260806 16:59:54.628401 22057 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
I20260806 16:59:54.629431 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.629227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49948)
0806 16:59:54.629325 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.629372 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 16:59:54.629611 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab.
Entry for principal kudu/127.7.153.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab.
I20260806 16:59:54.631836 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:38109
--webserver_interface=127.7.153.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab
--principal=kudu/127.7.153.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42771,127.7.153.61:37055,127.7.153.60:38109
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 16:59:54.647113 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 1
I20260806 16:59:54.648053 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.647750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49964)
0806 16:59:54.647900 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.647969 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 16:59:54.649003 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.648662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49976)
0806 16:59:54.648880 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.648938 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260806 16:59:54.649187 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
I20260806 16:59:54.678928 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 1
I20260806 16:59:54.679903 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.679548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:49984)
0806 16:59:54.679729 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.679808 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 16:59:54.680750 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.680483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50000)
0806 16:59:54.680606 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.680662 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 16:59:54.680910 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
I20260806 16:59:54.724383 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 2
I20260806 16:59:54.725322 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.725003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50004)
0806 16:59:54.725177 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.725243 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 16:59:54.726037 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.725825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50012)
0806 16:59:54.725934 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.725985 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 16:59:54.726187 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
I20260806 16:59:54.749136 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 2
I20260806 16:59:54.750042 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.749718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50014)
0806 16:59:54.749878 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.749949 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 16:59:54.750804 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.750573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50016)
0806 16:59:54.750682 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.750739 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 16:59:54.750963 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
W20260806 16:59:54.754778 22119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:54.755152 22119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:54.755259 22119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:54.759757 22119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:54.759853 22119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:54.759891 22119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:54.759950 22119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:54.760005 22119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:54.766139 22119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42771,127.7.153.61:37055,127.7.153.60:38109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab
--principal=kudu/127.7.153.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:38109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.153.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:54.767408 22119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:54.768488 22119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:54.777825 22124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:54.777997 22119 server_base.cc:1034] running on GCE node
W20260806 16:59:54.777827 22126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:54.777827 22128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:54.778875 22119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:54.780169 22119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:54.781388 22119 hybrid_clock.cc:648] HybridClock initialized: now 1786035594781372 us; error 32 us; skew 500 ppm
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:54.784744 22119 init.cc:377] Logged in from keytab as kudu/127.7.153.60@KRBTEST.COM (short username kudu)
I20260806 16:59:54.785861 22119 webserver.cc:460] Webserver started at http://127.7.153.60:43549/ using document root <none> and password file <none>
I20260806 16:59:54.786520 22119 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:54.786619 22119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:54.786863 22119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:54.789206 22119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data/instance:
uuid: "477578cc4f1949a681c8b61728c8d40f"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "b3d96f54e09842bf95e95a434b5a249e"
server_key_iv: "f63fedd4232c7c70d176985a868f5c5b"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.789878 22119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal/instance:
uuid: "477578cc4f1949a681c8b61728c8d40f"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "b3d96f54e09842bf95e95a434b5a249e"
server_key_iv: "f63fedd4232c7c70d176985a868f5c5b"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.794140 22119 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 16:59:54.797029 22135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:54.799082 22119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:59:54.799379 22119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal
uuid: "477578cc4f1949a681c8b61728c8d40f"
format_stamp: "Formatted at 2026-08-06 16:59:54 on dist-test-slave-cbsf"
server_key: "b3d96f54e09842bf95e95a434b5a249e"
server_key_iv: "f63fedd4232c7c70d176985a868f5c5b"
server_key_version: "encryptionkey@0"
I20260806 16:59:54.799561 22119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:54.821394 22119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:54.825379 22119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:54.825378 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 3
I20260806 16:59:54.825646 22119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:54.826253 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.825956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50022)
0806 16:59:54.826112 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.826173 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 16:59:54.827015 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.826754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50032)
0806 16:59:54.826861 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.826941 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 16:59:54.827200 22031 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38109: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38109: connect: Connection refused (error 111)
I20260806 16:59:54.834272 22119 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.60:38109
I20260806 16:59:54.834306 22188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.60:38109 every 8 connection(s)
I20260806 16:59:54.835754 22119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
I20260806 16:59:54.839100 22190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:54.840565 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22119
I20260806 16:59:54.840776 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786035416626244-7780-0/minicluster-data/master-2/wal/instance
I20260806 16:59:54.841097 7780 external_mini_cluster.cc:1428] Setting key 99f3457ecab26895bfc3706961700eb4
I20260806 16:59:54.842142 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 3
I20260806 16:59:54.844924 22190 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:54.857211 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.842633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50040)
0806 16:59:54.842832 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.842846 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.842929 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.844810 (+ 1881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.844813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.845046 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.845165 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.845173 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.846638 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.846643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.847440 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.847454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.848496 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.848500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.848607 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.849178 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.849197 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.850933 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.854376 (+ 3443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.854381 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.854386 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.854714 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.855179 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.855185 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.855189 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.855304 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.856491 (+ 1187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.856494 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.856614 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.856778 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.856969 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260806 16:59:54.858494 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.847281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36828 (local address 127.7.153.62:42771)
0806 16:59:54.847415 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.847419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.847827 (+ 408us) server_negotiation.cc:407] Connection header received
0806 16:59:54.848060 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.848063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.848121 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.848217 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.849260 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.849915 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.851067 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.851482 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.851608 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.854517 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.854521 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.854523 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.854550 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.856301 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.856908 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.856913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.856917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.857020 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.857372 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.857376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.857378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.857616 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.857710 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.858190 (+ 480us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.858331 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 16:59:54.859067 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.842776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50040 (local address 127.7.153.60:38109)
0806 16:59:54.843375 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.843381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.843400 (+ 19us) server_negotiation.cc:407] Connection header received
0806 16:59:54.844081 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.844100 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.844480 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.844883 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.845448 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.846494 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.847599 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.848345 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.848807 (+ 462us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.851214 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.851222 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.851238 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.851277 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.854191 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.854884 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.854890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.854898 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.855053 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.855683 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.855689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.855693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.856390 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.856538 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.857499 (+ 961us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.857971 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":501,"server-negotiator.queue_time_us":515,"spinlock_wait_cycles":41600,"thread_start_us":156,"threads_started":1}
I20260806 16:59:54.859076 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.842776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50038 (local address 127.7.153.60:38109)
0806 16:59:54.843332 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.843353 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.843401 (+ 48us) server_negotiation.cc:407] Connection header received
0806 16:59:54.844101 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.844106 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.844482 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.844883 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.846046 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.846833 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.847971 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.848346 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.848589 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.852930 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.852934 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.852937 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.852966 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.855531 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.856047 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.856052 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.856053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.856145 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.856470 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.856473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.856475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.856757 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.856929 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.857448 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.857876 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1080,"server-negotiator.queue_time_us":396,"spinlock_wait_cycles":9856,"thread_start_us":188,"threads_started":1}
I20260806 16:59:54.859264 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.847182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42771 (local address 127.0.0.1:36828)
0806 16:59:54.847697 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.847753 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.847927 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.848273 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.848279 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.848912 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.849078 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.849089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.850055 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.850058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.850893 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.850907 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.851753 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.851757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.851893 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.852458 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.852507 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.854343 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.856425 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.856436 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.856445 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.856803 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.857125 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.857129 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.857131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.857253 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.857776 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.857782 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.857906 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.858076 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.858257 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":137,"threads_started":1}
I20260806 16:59:54.861953 22190 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } has no permanent_uuid. Determining permanent_uuid...
I20260806 16:59:54.864310 22112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b: Bootstrap starting.
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 16:59:54.867846 22112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b: Neither blocks nor log segments found. Creating new log.
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:54.868755 22112 log.cc:824] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:54.871141 22112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b: No bootstrap required, opened a new log
I20260806 16:59:54.872056 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.862463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:37055 (local address 127.0.0.1:60868)
0806 16:59:54.862596 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.862612 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.862682 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.863089 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.863092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.863286 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.863440 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.863447 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.864505 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.864508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.865314 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.865327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.865868 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.865873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.865995 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.866573 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.866590 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.868024 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.870178 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.870183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.870185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.870471 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.870802 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.870805 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.870807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.870899 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.871437 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.871440 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.871560 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.871679 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.871839 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 16:59:54.872737 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.862702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60868 (local address 127.7.153.61:37055)
0806 16:59:54.862843 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.862848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.862862 (+ 14us) server_negotiation.cc:407] Connection header received
0806 16:59:54.862908 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.862911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.862958 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.863043 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.863587 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.864354 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.865426 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.865748 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.865857 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.868216 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.868221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.868224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.868255 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.870046 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.870597 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.870603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.870610 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.870710 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.870997 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.871014 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.871018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.871282 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.871383 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.872398 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.872531 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 16:59:54.873493 22190 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } has no permanent_uuid. Determining permanent_uuid...
I20260806 16:59:54.874161 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.862160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36836 (local address 127.7.153.62:42771)
0806 16:59:54.862276 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.862280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.862456 (+ 176us) server_negotiation.cc:407] Connection header received
0806 16:59:54.862648 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.862651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.862702 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.862760 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.863733 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.864297 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.865361 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.865748 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.865853 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.869047 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.869051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.869054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.869089 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.871827 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.872385 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.872388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.872390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.872498 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.872870 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.872876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.872877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.873114 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.873356 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.873867 (+ 511us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.874003 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 16:59:54.875439 22112 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.875764 22112 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:54.875839 22112 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f6c80a473848f0bd09b69b5e632b4b, State: Initialized, Role: FOLLOWER
I20260806 16:59:54.876423 22112 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.877045 22198 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:54.877287 22198 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:54.878186 22112 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
Aug 06 16:59:54 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 16:59:54.884543 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.874069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50054 (local address 127.7.153.60:38109)
0806 16:59:54.874173 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.874179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.874319 (+ 140us) server_negotiation.cc:407] Connection header received
0806 16:59:54.874473 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.874476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.874532 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.874618 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.875639 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.876413 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.877597 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.877921 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.878027 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.880634 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.880638 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.880640 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.880664 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.882322 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.882891 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.882895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.882897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.882996 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.883320 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.883326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.883331 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.883681 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.883777 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.884148 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.884305 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 16:59:54.885560 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.874037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50054)
0806 16:59:54.874261 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.874274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.874379 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.874932 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.874935 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.875126 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.875378 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.875410 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.876580 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.876588 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.877452 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.877467 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.878145 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.878148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:54.878225 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.878830 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:54.878845 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:54.880473 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:54.882462 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.882467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.882469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.882750 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.883116 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:54.883119 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:54.883121 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:54.883212 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:54.883849 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:54.883853 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:54.883951 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 16:59:54.884804 (+ 853us) client_negotiation.cc:240] Negotiation successful
0806 16:59:54.884963 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
W20260806 16:59:54.885802 22209 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:59:54.885885 22209 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:59:54.883095 22038 master_runner.cc:186] Error getting master registration for 127.7.153.62:42771: OK, instance_id { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" instance_seqno: 1786035594342126 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 16:59:54.888054 22038 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 16:59:54.888923 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.875998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60874 (local address 127.7.153.61:37055)
0806 16:59:54.876261 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.876281 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.876630 (+ 349us) server_negotiation.cc:407] Connection header received
0806 16:59:54.876919 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.876923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.876983 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.877043 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.878042 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.878633 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.879666 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.879908 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.880030 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.884733 (+ 4703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.884739 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.884742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.884776 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.886592 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.887167 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.887171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.887173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.887279 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.887678 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.887683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.887684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.887952 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.888122 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.888567 (+ 445us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.888739 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 16:59:54.890307 22190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: Bootstrap starting.
I20260806 16:59:54.892913 22190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:54.893556 22198 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:59:54.893977 22190 log.cc:824] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:54.893959 22198 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.895231 22198 leader_election.cc:288] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e71dd62604846a2b9c62b2e3fec6087 (127.7.153.62:42771), 477578cc4f1949a681c8b61728c8d40f (127.7.153.60:38109)
I20260806 16:59:54.897706 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:59:54.897955 22190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: No bootstrap required, opened a new log
I20260806 16:59:54.902887 22190 raft_consensus.cc:348] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.903241 22190 raft_consensus.cc:374] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:54.903307 22190 raft_consensus.cc:729] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 477578cc4f1949a681c8b61728c8d40f, State: Initialized, Role: FOLLOWER
I20260806 16:59:54.903970 22190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.904281 22218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 16:59:54.904894 22218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.905809 22190 sys_catalog.cc:564] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:59:54.905920 22162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "477578cc4f1949a681c8b61728c8d40f" is_pre_election: true
I20260806 16:59:54.906661 22162 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f6c80a473848f0bd09b69b5e632b4b in term 0.
I20260806 16:59:54.907222 22057 leader_election.cc:302] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 477578cc4f1949a681c8b61728c8d40f, a0f6c80a473848f0bd09b69b5e632b4b; no voters:
I20260806 16:59:54.907599 22198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 16:59:54.907701 22198 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 16:59:54.907770 22198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:54.909423 22198 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.909471 22219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:54.909641 22219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:54.909588 22083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "477578cc4f1949a681c8b61728c8d40f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" is_pre_election: true
I20260806 16:59:54.909852 22083 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 477578cc4f1949a681c8b61728c8d40f in current term 1: Already voted for candidate a0f6c80a473848f0bd09b69b5e632b4b in this term.
I20260806 16:59:54.909866 22198 leader_election.cc:288] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [CANDIDATE]: Term 1 election: Requested vote from peers 8e71dd62604846a2b9c62b2e3fec6087 (127.7.153.62:42771), 477578cc4f1949a681c8b61728c8d40f (127.7.153.60:38109)
I20260806 16:59:54.910440 22162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "477578cc4f1949a681c8b61728c8d40f"
I20260806 16:59:54.910578 22162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:54.915684 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.900461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60880 (local address 127.7.153.61:37055)
0806 16:59:54.900608 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.900614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.901251 (+ 637us) server_negotiation.cc:407] Connection header received
0806 16:59:54.901446 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.901452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.901510 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.901595 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.902703 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.903279 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.904885 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.905259 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.905354 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.911114 (+ 5760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.911119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.911122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.911159 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.913458 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.914071 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.914076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.914080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.914182 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.914526 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.914530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.914531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.914783 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.914928 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.915337 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.915487 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 16:59:54.913847 22119 master_runner.cc:186] Error getting master registration for 127.7.153.62:42771: OK, instance_id { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" instance_seqno: 1786035594342126 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 16:59:54.917829 22119 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 16:59:54.918926 22162 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f6c80a473848f0bd09b69b5e632b4b in term 1.
I20260806 16:59:54.919814 22057 leader_election.cc:302] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 477578cc4f1949a681c8b61728c8d40f, a0f6c80a473848f0bd09b69b5e632b4b; no voters:
I20260806 16:59:54.920055 22198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:59:54.920363 22198 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [term 1 LEADER]: Becoming Leader. State: Replica: a0f6c80a473848f0bd09b69b5e632b4b, State: Running, Role: LEADER
I20260806 16:59:54.920924 22198 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:54.923060 22198 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0f6c80a473848f0bd09b69b5e632b4b. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:54.923213 22198 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:54.925985 22235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:59:54.927117 22235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:59:54.927042 22218 leader_election.cc:288] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e71dd62604846a2b9c62b2e3fec6087 (127.7.153.62:42771), a0f6c80a473848f0bd09b69b5e632b4b (127.7.153.61:37055)
I20260806 16:59:54.928411 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.909169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36846 (local address 127.7.153.62:42771)
0806 16:59:54.909460 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.909467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.911108 (+ 1641us) server_negotiation.cc:407] Connection header received
0806 16:59:54.911445 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.911449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.911506 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.911564 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.913440 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.914338 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.917281 (+ 2943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.917715 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.917813 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.922609 (+ 4796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.922614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.922617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.922657 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.924841 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.925897 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.925902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.925904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.926019 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.926719 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.926723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.926726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.926991 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.927136 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.928070 (+ 934us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.928225 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
W20260806 16:59:54.928377 22230 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 16:59:54.928519 22230 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 16:59:54.935935 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.911914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.7.153.60:38109)
0806 16:59:54.912047 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.912052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.912070 (+ 18us) server_negotiation.cc:407] Connection header received
0806 16:59:54.912375 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.912380 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.912439 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.912500 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:54.918933 (+ 6433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.919678 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.924550 (+ 4872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:54.924964 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:54.925067 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:54.929981 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:54.929986 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:54.929989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:54.930021 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:54.932437 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.933348 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.933355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.933372 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.933477 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:54.933988 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:54.933991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:54.933993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:54.934255 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:54.934378 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:54.935581 (+ 1203us) server_negotiation.cc:299] Negotiation successful
0806 16:59:54.935743 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 16:59:54.958549 22162 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 1 FOLLOWER]: Refusing update from remote peer a0f6c80a473848f0bd09b69b5e632b4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:59:54.959642 22198 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:59:54.964793 22218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0f6c80a473848f0bd09b69b5e632b4b. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:54.964970 22218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:54.973189 22233 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:54.973372 22233 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:54.974372 22218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:54.974541 22218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:54.975270 22238 mvcc.cc:205] Tried to move back new op lower bound from 7315601796935479296 to 7315601796799766528. Current Snapshot: MvccSnapshot[applied={T|T < 7315601796935479296}]
I20260806 16:59:54.991348 22031 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } attempt: 4
I20260806 16:59:54.994686 22235 catalog_manager.cc:1347] Generated new cluster ID: a4e949b428e341e8b4cc01527d1274b6
I20260806 16:59:54.994867 22235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 16:59:55 dist-test-slave-cbsf krb5kdc[21944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035594, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
I20260806 16:59:55.014882 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.992051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38109 (local address 127.0.0.1:50076)
0806 16:59:54.992259 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:54.992279 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:54.992388 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:54.998204 (+ 5816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:54.998209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:54.998458 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:54.998591 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:54.998602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:55.005299 (+ 6697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:55.005303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:55.006520 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:55.006545 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:55.008297 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:55.008301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:55.008412 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:55.009064 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:55.009082 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:55.010750 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:55.013103 (+ 2353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:55.013106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:55.013109 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:55.013376 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:55.013688 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:55.013691 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:55.013693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:55.013781 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:55.014292 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:55.014299 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:55.014411 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 16:59:55.014515 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 16:59:55.014681 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 16:59:55.015529 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:54.993122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50076 (local address 127.7.153.60:38109)
0806 16:59:54.997759 (+ 4637us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:54.997764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:54.997788 (+ 24us) server_negotiation.cc:407] Connection header received
0806 16:59:54.997851 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:54.997854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:54.997931 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:54.998038 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:55.004099 (+ 6061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:55.004947 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:55.007442 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:55.007835 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:55.007942 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:55.010952 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:55.010956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:55.010959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:55.010994 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:55.012939 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:55.013489 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:55.013493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:55.013495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:55.013590 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:55.013882 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:55.013885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:55.013887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:55.014148 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:55.014236 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:55.015220 (+ 984us) server_negotiation.cc:299] Negotiation successful
0806 16:59:55.015359 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4505}
I20260806 16:59:55.019414 22031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: Bootstrap starting.
I20260806 16:59:55.024668 22031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:55.026990 22031 log.cc:824] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:55.035010 22031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: No bootstrap required, opened a new log
I20260806 16:59:55.042734 22031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:55.043043 22031 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:55.043103 22031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e71dd62604846a2b9c62b2e3fec6087, State: Initialized, Role: FOLLOWER
I20260806 16:59:55.043684 22031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } }
I20260806 16:59:55.045408 22031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:59:55.045696 22000 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:55.047580 22000 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 1 FOLLOWER]: Refusing update from remote peer a0f6c80a473848f0bd09b69b5e632b4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 16:59:55.047714 22235 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:59:55.048564 22198 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 16:59:55.049156 22002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "477578cc4f1949a681c8b61728c8d40f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e71dd62604846a2b9c62b2e3fec6087" is_pre_election: true
I20260806 16:59:55.049441 22235 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:59:55.049474 22002 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 477578cc4f1949a681c8b61728c8d40f in term 1.
I20260806 16:59:55.050020 22139 leader_election.cc:302] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 477578cc4f1949a681c8b61728c8d40f, 8e71dd62604846a2b9c62b2e3fec6087; no voters: a0f6c80a473848f0bd09b69b5e632b4b
I20260806 16:59:55.050314 22218 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260806 16:59:55.050951 22003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e71dd62604846a2b9c62b2e3fec6087" is_pre_election: true
I20260806 16:59:55.051100 22003 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f6c80a473848f0bd09b69b5e632b4b in term 1.
I20260806 16:59:55.051445 22001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e71dd62604846a2b9c62b2e3fec6087"
I20260806 16:59:55.052748 22001 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f6c80a473848f0bd09b69b5e632b4b in term 1.
I20260806 16:59:55.055889 22243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:55.056064 22243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:55.062870 22243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0f6c80a473848f0bd09b69b5e632b4b. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:55.063059 22243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:55.063174 22243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:55.063275 22243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 16:59:55.063897 22235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b: Generated new TSK 0
I20260806 16:59:55.065379 22235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:59:55.071825 22254 mvcc.cc:205] Tried to move back new op lower bound from 7315601797252104192 to 7315601796799766528. Current Snapshot: MvccSnapshot[applied={T|T < 7315601796935479296}]
I20260806 16:59:55.072717 22233 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e71dd62604846a2b9c62b2e3fec6087" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42771 } } peers { permanent_uuid: "a0f6c80a473848f0bd09b69b5e632b4b" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 37055 } } peers { permanent_uuid: "477578cc4f1949a681c8b61728c8d40f" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38109 } } }
I20260806 16:59:55.072882 22233 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0f6c80a473848f0bd09b69b5e632b4b [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:55.083160 22257 catalog_manager.cc:1259] Loaded cluster ID: a4e949b428e341e8b4cc01527d1274b6
I20260806 16:59:55.083267 22257 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: loading cluster ID for follower catalog manager: success
I20260806 16:59:55.085852 22257 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: acquiring CA information for follower catalog manager: success
I20260806 16:59:55.087579 22257 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8e71dd62604846a2b9c62b2e3fec6087: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 16:59:55.930102 22230 catalog_manager.cc:1259] Loaded cluster ID: a4e949b428e341e8b4cc01527d1274b6
I20260806 16:59:55.930241 22230 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: loading cluster ID for follower catalog manager: success
I20260806 16:59:55.931979 22230 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: acquiring CA information for follower catalog manager: success
I20260806 16:59:55.933320 22230 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 477578cc4f1949a681c8b61728c8d40f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 16:59:56.151671 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 21958
I20260806 16:59:56.161005 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22038
I20260806 16:59:56.172570 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22119
2026-08-06T16:59:56Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3273 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:59:56 dist-test-slave-cbsf krb5kdc[22269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:59:56 dist-test-slave-cbsf krb5kdc[22269](info): set up 2 sockets
Aug 06 16:59:56 dist-test-slave-cbsf krb5kdc[22269](info): commencing operation
krb5kdc: starting...
W20260806 16:59:57.277834 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:59:57 dist-test-slave-cbsf krb5kdc[22269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:59:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:59:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:59:57.440551 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37877
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:37877
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:57.565253 22283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:57.565650 22283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:57.565730 22283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:57.570459 22283 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:57.570595 22283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:57.570631 22283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:57.570670 22283 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:57.570705 22283 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:57.576404 22283 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:37877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:57.577762 22283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:57.578882 22283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:57.588022 22289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:57.588063 22283 server_base.cc:1034] running on GCE node
W20260806 16:59:57.588083 22293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:57.588078 22291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:57.589003 22283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:57.590301 22283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:57.591557 22283 hybrid_clock.cc:648] HybridClock initialized: now 1786035597591525 us; error 49 us; skew 500 ppm
Aug 06 16:59:57 dist-test-slave-cbsf krb5kdc[22269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035597, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:57.594967 22283 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:59:57.596052 22283 webserver.cc:460] Webserver started at http://127.7.153.62:39441/ using document root <none> and password file <none>
I20260806 16:59:57.596675 22283 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:57.596832 22283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:57.597098 22283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:57.599421 22283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "fa2f3fadfb85403692dd0498dd9849be"
format_stamp: "Formatted at 2026-08-06 16:59:57 on dist-test-slave-cbsf"
server_key: "88eecbaa45342900b6cdf9b79fd9784b"
server_key_iv: "5f200d7b7e7a7e37a9663faaa1022392"
server_key_version: "encryptionkey@0"
I20260806 16:59:57.600063 22283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "fa2f3fadfb85403692dd0498dd9849be"
format_stamp: "Formatted at 2026-08-06 16:59:57 on dist-test-slave-cbsf"
server_key: "88eecbaa45342900b6cdf9b79fd9784b"
server_key_iv: "5f200d7b7e7a7e37a9663faaa1022392"
server_key_version: "encryptionkey@0"
I20260806 16:59:57.604346 22283 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260806 16:59:57.607194 22301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:57.608685 22283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 16:59:57.608916 22283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "fa2f3fadfb85403692dd0498dd9849be"
format_stamp: "Formatted at 2026-08-06 16:59:57 on dist-test-slave-cbsf"
server_key: "88eecbaa45342900b6cdf9b79fd9784b"
server_key_iv: "5f200d7b7e7a7e37a9663faaa1022392"
server_key_version: "encryptionkey@0"
I20260806 16:59:57.609084 22283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:57.622221 22283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:57.625927 22283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:57.626163 22283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:57.634332 22283 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:37877
I20260806 16:59:57.634358 22354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:37877 every 8 connection(s)
I20260806 16:59:57.635442 22283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:59:57.638864 22355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:57.639329 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22283
I20260806 16:59:57.639439 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:59:57.639780 7780 external_mini_cluster.cc:1428] Setting key a2c4e1806f1e032a9ce7d39db5f35261
I20260806 16:59:57.647007 22355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be: Bootstrap starting.
I20260806 16:59:57.649848 22355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be: Neither blocks nor log segments found. Creating new log.
Aug 06 16:59:57 dist-test-slave-cbsf krb5kdc[22269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:57.650892 22355 log.cc:824] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:57.653664 22355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be: No bootstrap required, opened a new log
I20260806 16:59:57.656608 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:57.641382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48984 (local address 127.7.153.62:37877)
0806 16:59:57.641898 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:57.641922 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:57.641983 (+ 61us) server_negotiation.cc:407] Connection header received
0806 16:59:57.642768 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:57.642796 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:57.643301 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:57.643709 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:57.644516 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:57.646140 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:57.647101 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:57.647793 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:57.647966 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:57.651061 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:57.651071 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:57.651104 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:57.651139 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:57.653194 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:57.653811 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:57.653821 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:57.653827 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:57.653949 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:57.654328 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:57.654332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:57.654333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:57.654874 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:57.655043 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:57.655396 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 16:59:57.655783 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":161,"threads_started":1}
I20260806 16:59:57.658133 22355 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2f3fadfb85403692dd0498dd9849be" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37877 } }
I20260806 16:59:57.658433 22355 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:57.658491 22355 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa2f3fadfb85403692dd0498dd9849be, State: Initialized, Role: FOLLOWER
I20260806 16:59:57.659022 22355 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2f3fadfb85403692dd0498dd9849be" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37877 } }
I20260806 16:59:57.659237 22355 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:59:57.659314 22355 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:59:57.659426 22355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:57.659940 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 16:59:57.660657 22355 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2f3fadfb85403692dd0498dd9849be" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37877 } }
I20260806 16:59:57.661098 22355 leader_election.cc:302] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa2f3fadfb85403692dd0498dd9849be; no voters:
I20260806 16:59:57.661433 22355 leader_election.cc:288] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:59:57.661561 22360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:59:57.661808 22360 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [term 1 LEADER]: Becoming Leader. State: Replica: fa2f3fadfb85403692dd0498dd9849be, State: Running, Role: LEADER
I20260806 16:59:57.662153 22360 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2f3fadfb85403692dd0498dd9849be" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37877 } }
I20260806 16:59:57.662820 22355 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:59:57.663939 22362 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa2f3fadfb85403692dd0498dd9849be. Latest consensus state: current_term: 1 leader_uuid: "fa2f3fadfb85403692dd0498dd9849be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2f3fadfb85403692dd0498dd9849be" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37877 } } }
I20260806 16:59:57.664084 22362 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:57.664394 22361 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa2f3fadfb85403692dd0498dd9849be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa2f3fadfb85403692dd0498dd9849be" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37877 } } }
I20260806 16:59:57.664491 22361 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:57.664600 22371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:59:57.668159 22371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:59:57.674643 22371 catalog_manager.cc:1347] Generated new cluster ID: b67d8603ada74e02a9953b8316eae49d
I20260806 16:59:57.674762 22371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:59:57.702589 22371 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:59:57.704087 22371 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:59:57.711853 22371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa2f3fadfb85403692dd0498dd9849be: Generated new TSK 0
I20260806 16:59:57.713040 22371 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 16:59:57.768517 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22283
2026-08-06T16:59:57Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1594 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 16:59:57 dist-test-slave-cbsf krb5kdc[22385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 16:59:57 dist-test-slave-cbsf krb5kdc[22385](info): set up 2 sockets
Aug 06 16:59:57 dist-test-slave-cbsf krb5kdc[22385](info): commencing operation
krb5kdc: starting...
W20260806 16:59:58.857610 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 16:59:58 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T16:59:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T16:59:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 16:59:59.002511 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34207
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:59.126698 22398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:59.127027 22398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:59.127072 22398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:59.131510 22398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 16:59:59.131592 22398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:59.131614 22398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:59.131631 22398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 16:59:59.131647 22398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 16:59:59.138207 22398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:59.139501 22398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:59.140611 22398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:59.150064 22407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.150058 22405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.150058 22404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:59.150559 22398 server_base.cc:1034] running on GCE node
I20260806 16:59:59.151268 22398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:59.152585 22398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:59.153820 22398 hybrid_clock.cc:648] HybridClock initialized: now 1786035599153783 us; error 51 us; skew 500 ppm
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:59.161446 22398 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 16:59:59.162729 22398 webserver.cc:460] Webserver started at http://127.7.153.62:41573/ using document root <none> and password file <none>
I20260806 16:59:59.163403 22398 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:59.163511 22398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:59.163915 22398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:59.166637 22398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c2940d182ab54a799b8eacc2561bae45"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "5961ce8f319cd0e198ffffce949d6384"
server_key_iv: "c4f76f272623c43013e982ee0699ad8a"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.167351 22398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c2940d182ab54a799b8eacc2561bae45"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "5961ce8f319cd0e198ffffce949d6384"
server_key_iv: "c4f76f272623c43013e982ee0699ad8a"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.172042 22398 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 16:59:59.175174 22415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.176966 22398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:59:59.177203 22398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c2940d182ab54a799b8eacc2561bae45"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "5961ce8f319cd0e198ffffce949d6384"
server_key_iv: "c4f76f272623c43013e982ee0699ad8a"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.177379 22398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:59.195830 22398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:59.199613 22398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:59.199854 22398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:59.208685 22398 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34207
I20260806 16:59:59.209153 22469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34207 every 8 connection(s)
I20260806 16:59:59.209859 22398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 16:59:59.212496 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22398
I20260806 16:59:59.212639 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 16:59:59.213020 7780 external_mini_cluster.cc:1428] Setting key 734be4a51bb6facbb2d5d5e4beb749ae
I20260806 16:59:59.213284 22470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 16:59:59.221408 22470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap starting.
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:59.224396 22470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Neither blocks nor log segments found. Creating new log.
I20260806 16:59:59.225304 22470 log.cc:824] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Log is configured to *not* fsync() on all Append() calls
I20260806 16:59:59.227788 22470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: No bootstrap required, opened a new log
I20260806 16:59:59.229920 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:59.214652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34270 (local address 127.7.153.62:34207)
0806 16:59:59.215103 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:59.215139 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:59.215176 (+ 37us) server_negotiation.cc:407] Connection header received
0806 16:59:59.215856 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:59.215874 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:59.216234 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:59.216532 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:59.217663 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.218706 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.220002 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.220643 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.220889 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:59.223952 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:59.223958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:59.223976 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:59.224012 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:59.226227 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:59.226781 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:59.226786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:59.226792 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:59.226913 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:59.227234 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:59.227237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:59.227241 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:59.227689 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:59.227918 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:59.228223 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 16:59:59.228555 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":167,"threads_started":1}
I20260806 16:59:59.232299 22470 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 16:59:59.232677 22470 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 16:59:59.232770 22470 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2940d182ab54a799b8eacc2561bae45, State: Initialized, Role: FOLLOWER
I20260806 16:59:59.233281 22470 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 16:59:59.233429 22470 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 16:59:59.233474 22470 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 16:59:59.233546 22470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 0 FOLLOWER]: Advancing to term 1
I20260806 16:59:59.234967 22470 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 16:59:59.235397 22470 leader_election.cc:302] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2940d182ab54a799b8eacc2561bae45; no voters:
I20260806 16:59:59.235773 22470 leader_election.cc:288] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 16:59:59.235862 22475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 16:59:59.236080 22475 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 LEADER]: Becoming Leader. State: Replica: c2940d182ab54a799b8eacc2561bae45, State: Running, Role: LEADER
I20260806 16:59:59.236855 22475 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 16:59:59.237375 22470 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 16:59:59.239260 22476 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2940d182ab54a799b8eacc2561bae45. Latest consensus state: current_term: 1 leader_uuid: "c2940d182ab54a799b8eacc2561bae45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } } }
I20260806 16:59:59.239430 22476 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:59.239713 22477 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2940d182ab54a799b8eacc2561bae45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } } }
I20260806 16:59:59.240214 22477 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: This master's current role is: LEADER
I20260806 16:59:59.239816 22492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 16:59:59.243572 22492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 16:59:59.250685 22492 catalog_manager.cc:1347] Generated new cluster ID: df4db4c73f914d638acce8ec3c77c654
I20260806 16:59:59.250792 22492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 16:59:59.262953 22492 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 16:59:59.264297 22492 catalog_manager.cc:1504] Loading token signing keys...
I20260806 16:59:59.271224 22492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Generated new TSK 0
I20260806 16:59:59.272157 22492 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 16:59:59.312965 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34207
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:59.440131 22499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:59.440435 22499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:59.440531 22499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:59.444898 22499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:59.444993 22499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:59.445101 22499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 16:59:59.450917 22499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:59.452208 22499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:59.453377 22499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:59.464505 22504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.464448 22507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:59.464663 22499 server_base.cc:1034] running on GCE node
W20260806 16:59:59.464485 22505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:59.465384 22499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:59.466090 22499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:59.467315 22499 hybrid_clock.cc:648] HybridClock initialized: now 1786035599467276 us; error 50 us; skew 500 ppm
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:59.470779 22499 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 16:59:59.471900 22499 webserver.cc:460] Webserver started at http://127.7.153.1:40147/ using document root <none> and password file <none>
I20260806 16:59:59.472553 22499 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:59.472822 22499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:59.473232 22499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:59.475574 22499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "ab3f518398d7424fb75a439a3ab26670"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "0e626660e8e6f8d5defa06d0dfac4c22"
server_key_iv: "c94edc577ee3274ff13773279b4c29c8"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.476223 22499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "ab3f518398d7424fb75a439a3ab26670"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "0e626660e8e6f8d5defa06d0dfac4c22"
server_key_iv: "c94edc577ee3274ff13773279b4c29c8"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.480415 22499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260806 16:59:59.484117 22516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.485724 22499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 16:59:59.485903 22499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "ab3f518398d7424fb75a439a3ab26670"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "0e626660e8e6f8d5defa06d0dfac4c22"
server_key_iv: "c94edc577ee3274ff13773279b4c29c8"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.486047 22499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:59.515293 22499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:59.519371 22499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:59.519630 22499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:59.520299 22499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:59.521247 22499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:59.521327 22499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.521394 22499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:59.521438 22499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.532104 22499 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:34439
I20260806 16:59:59.532191 22636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:34439 every 8 connection(s)
I20260806 16:59:59.533413 22499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 16:59:59.543321 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22499
I20260806 16:59:59.543479 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 16:59:59.543843 7780 external_mini_cluster.cc:1428] Setting key 24484c4ac2ccd2fff4d02cfaf5866608
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:59.551645 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:59.535871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38527 (local address 127.7.153.62:34207)
0806 16:59:59.536058 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:59.536064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:59.537480 (+ 1416us) server_negotiation.cc:407] Connection header received
0806 16:59:59.538736 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:59.538740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:59.538830 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:59.538963 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:59.540531 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.541177 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.542541 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.542796 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.542904 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:59.547449 (+ 4545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:59.547453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:59.547455 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:59.547486 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:59.549158 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:59.549812 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:59.549820 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:59.549821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:59.549903 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:59.550320 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:59.550324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:59.550325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:59.550548 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:59.550662 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:59.551293 (+ 631us) server_negotiation.cc:299] Negotiation successful
0806 16:59:59.551461 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 16:59:59.552762 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:59.536341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:38527)
0806 16:59:59.537293 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:59.537352 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:59.538303 (+ 951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:59.539259 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:59.539268 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:59.539731 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:59.540313 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:59.540329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.541324 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.541327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:59.542358 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:59.542369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.543116 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.543123 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:59.543370 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:59.544222 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:59.544271 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:59.547191 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:59.549314 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:59.549322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:59.549346 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:59.549680 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:59.550014 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:59.550017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:59.550019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:59.550208 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:59.550662 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:59.550672 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:59.550985 (+ 313us) client_negotiation.cc:769] Sending connection context
0806 16:59:59.551202 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 16:59:59.551615 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":136,"threads_started":1}
I20260806 16:59:59.554623 22637 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34207
I20260806 16:59:59.554937 22637 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:59.555642 22637 heartbeater.cc:511] Master 127.7.153.62:34207 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 16:59:59.557674 22433 ts_manager.cc:194] Registered new tserver with Master: ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439)
I20260806 16:59:59.558950 22433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:38527
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 16:59:59.581367 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34207
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:59.709131 22643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:59.709444 22643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:59.709498 22643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:59.713754 22643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:59.713835 22643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:59.713903 22643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 16:59:59.719677 22643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:59.720918 22643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:59.721994 22643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:59.732580 22649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.732558 22651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.732564 22648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:59.732754 22643 server_base.cc:1034] running on GCE node
I20260806 16:59:59.733459 22643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:59.734234 22643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:59.735605 22643 hybrid_clock.cc:648] HybridClock initialized: now 1786035599735560 us; error 39 us; skew 500 ppm
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 16:59:59.739534 22643 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 16:59:59.740876 22643 webserver.cc:460] Webserver started at http://127.7.153.2:41999/ using document root <none> and password file <none>
I20260806 16:59:59.741532 22643 fs_manager.cc:359] Metadata directory not provided
I20260806 16:59:59.741631 22643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 16:59:59.741888 22643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 16:59:59.744210 22643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "19ba89fbae774f7282fac054eb579601"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "ff932b576716aea3335c6c5cfa412f84"
server_key_iv: "560be6acfb2761e1433b6e71ab32df7b"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.744949 22643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "19ba89fbae774f7282fac054eb579601"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "ff932b576716aea3335c6c5cfa412f84"
server_key_iv: "560be6acfb2761e1433b6e71ab32df7b"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.749743 22643 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260806 16:59:59.752864 22658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.754920 22643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 16:59:59.755177 22643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "19ba89fbae774f7282fac054eb579601"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "ff932b576716aea3335c6c5cfa412f84"
server_key_iv: "560be6acfb2761e1433b6e71ab32df7b"
server_key_version: "encryptionkey@0"
I20260806 16:59:59.755363 22643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 16:59:59.783943 22643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 16:59:59.787730 22643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 16:59:59.787963 22643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 16:59:59.788619 22643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 16:59:59.789637 22643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 16:59:59.789717 22643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.789784 22643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 16:59:59.789834 22643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 16:59:59.801131 22643 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34557
I20260806 16:59:59.801164 22780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34557 every 8 connection(s)
I20260806 16:59:59.802260 22643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 16:59:59.811466 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22643
I20260806 16:59:59.811618 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 16:59:59.811892 7780 external_mini_cluster.cc:1428] Setting key d5b9017d4d3c848919764676d06b05ae
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 16:59:59.819176 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:59.804966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:56071 (local address 127.7.153.62:34207)
0806 16:59:59.805126 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 16:59:59.805129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 16:59:59.805997 (+ 868us) server_negotiation.cc:407] Connection header received
0806 16:59:59.807279 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 16:59:59.807282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 16:59:59.807334 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 16:59:59.807414 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 16:59:59.808881 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.809449 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.810708 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.810934 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.811032 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:59.814261 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 16:59:59.814269 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 16:59:59.814276 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 16:59:59.814315 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 16:59:59.816276 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:59.817138 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:59.817142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:59.817143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:59.817265 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 16:59:59.817766 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 16:59:59.817769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 16:59:59.817771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 16:59:59.818000 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 16:59:59.818085 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 16:59:59.818875 (+ 790us) server_negotiation.cc:299] Negotiation successful
0806 16:59:59.819028 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 16:59:59.820576 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 16:59:59.805296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:56071)
0806 16:59:59.805807 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 16:59:59.805851 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 16:59:59.807059 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 16:59:59.807644 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 16:59:59.807652 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 16:59:59.808062 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0806 16:59:59.808621 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:59.808636 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.809602 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.809605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:59.810555 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 16:59:59.810565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 16:59:59.811145 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 16:59:59.811152 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 16:59:59.811382 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 16:59:59.812136 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 16:59:59.812154 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 16:59:59.814035 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 16:59:59.816459 (+ 2424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:59.816469 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:59.816494 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:59.816986 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:59.817384 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 16:59:59.817387 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 16:59:59.817390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 16:59:59.817614 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 16:59:59.818129 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 16:59:59.818140 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 16:59:59.818545 (+ 405us) client_negotiation.cc:769] Sending connection context
0806 16:59:59.818793 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 16:59:59.819227 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":146,"threads_started":1}
I20260806 16:59:59.822239 22781 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34207
I20260806 16:59:59.822562 22781 heartbeater.cc:464] Registering TS with master...
I20260806 16:59:59.823151 22781 heartbeater.cc:511] Master 127.7.153.62:34207 requested a full tablet report, sending...
I20260806 16:59:59.824487 22433 ts_manager.cc:194] Registered new tserver with Master: 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557)
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 16:59:59.825314 22433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:56071
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 16:59:59.845687 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34207
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 16:59:59.968009 22787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 16:59:59.968389 22787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 16:59:59.968469 22787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 16:59:59.972990 22787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 16:59:59.973089 22787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 16:59:59.973186 22787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 16:59:59.979044 22787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 16:59:59.980352 22787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 16:59:59.981539 22787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 16:59:59.994300 22793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.994402 22792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 16:59:59.994334 22795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 16:59:59.994553 22787 server_base.cc:1034] running on GCE node
I20260806 16:59:59.995177 22787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 16:59:59.995959 22787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 16:59:59.997143 22787 hybrid_clock.cc:648] HybridClock initialized: now 1786035599997123 us; error 36 us; skew 500 ppm
Aug 06 16:59:59 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:00.000946 22787 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:00:00.002398 22787 webserver.cc:460] Webserver started at http://127.7.153.3:44143/ using document root <none> and password file <none>
I20260806 17:00:00.003105 22787 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:00.003189 22787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:00.003430 22787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:00:00.005782 22787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "da82cfb1bff74113a6aa173d435be9ff"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "e304fcf87d4feea1a91dd3aa9dfa1551"
server_key_iv: "e3a28c8e20e7b3caf54a25bad6fc96c9"
server_key_version: "encryptionkey@0"
I20260806 17:00:00.006392 22787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "da82cfb1bff74113a6aa173d435be9ff"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "e304fcf87d4feea1a91dd3aa9dfa1551"
server_key_iv: "e3a28c8e20e7b3caf54a25bad6fc96c9"
server_key_version: "encryptionkey@0"
I20260806 17:00:00.010555 22787 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 17:00:00.013384 22802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:00.014946 22787 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:00.015123 22787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "da82cfb1bff74113a6aa173d435be9ff"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "e304fcf87d4feea1a91dd3aa9dfa1551"
server_key_iv: "e3a28c8e20e7b3caf54a25bad6fc96c9"
server_key_version: "encryptionkey@0"
I20260806 17:00:00.015273 22787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:00.044088 22787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:00.047832 22787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:00.048085 22787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:00.048797 22787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:00.049752 22787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:00.049824 22787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:00.049897 22787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:00.049950 22787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:00.060075 22787 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:35427
I20260806 17:00:00.060097 22919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:35427 every 8 connection(s)
I20260806 17:00:00.061295 22787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:00:00.064858 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22787
I20260806 17:00:00.065006 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:00:00.065352 7780 external_mini_cluster.cc:1428] Setting key c92ed6d25765c48b8337f980b7d03f7b
Aug 06 17:00:00 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035599, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:00.077838 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.063535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:40619 (local address 127.7.153.62:34207)
0806 17:00:00.063836 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.063841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.065144 (+ 1303us) server_negotiation.cc:407] Connection header received
0806 17:00:00.066396 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.066399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.066465 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.066591 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:00.068203 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.068879 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.070217 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.070477 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.070640 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.073748 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:00.073752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:00.073755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:00.073786 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:00.075286 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.075941 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.075944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.075946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.076033 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.076443 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.076447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.076449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.076682 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:00.076864 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.077495 (+ 631us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.077651 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260806 17:00:00.078936 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.063927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:40619)
0806 17:00:00.064931 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.065006 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.066118 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.066796 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.066804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.067407 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:00.068038 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.068055 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.069020 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.069026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.070057 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.070068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.070710 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.070714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.070924 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.071663 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:00.071683 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:00.073498 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:00.075442 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:00.075449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:00.075475 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:00.075799 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:00.076150 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:00.076153 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:00.076155 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:00.076325 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:00.076861 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:00.076870 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:00.077205 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.077434 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.077849 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":138,"threads_started":1}
I20260806 17:00:00.080255 22920 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34207
I20260806 17:00:00.080540 22920 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:00.081166 22920 heartbeater.cc:511] Master 127.7.153.62:34207 requested a full tablet report, sending...
I20260806 17:00:00.082406 22428 ts_manager.cc:194] Registered new tserver with Master: da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
I20260806 17:00:00.083077 22428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:40619
I20260806 17:00:00.092324 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:00:00.102526 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.094680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.7.153.62:34207)
0806 17:00:00.094819 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.094823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.094958 (+ 135us) server_negotiation.cc:407] Connection header received
0806 17:00:00.095017 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.095019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.095066 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.095162 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:00.095927 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.096482 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.097436 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.097655 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.097742 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.099343 (+ 1601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:00.099347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:00.099349 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:00.099376 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:00.100822 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.101296 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.101299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.101300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.101386 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.101666 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.101669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.101670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.101929 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:00.102047 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.102275 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.102388 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 17:00:00.106328 22428 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:00:00.109684 22428 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:00:00.127590 22933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.121534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34439 (local address 127.0.0.1:54306)
0806 17:00:00.122231 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.122290 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.122439 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.123213 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.123219 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.123242 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:00.123392 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.123403 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.124969 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.124973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.126047 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.126058 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.126966 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.126970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.127088 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.127133 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.127256 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.127400 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":38,"thread_start_us":82,"threads_started":1}
I20260806 17:00:00.127597 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.122124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.7.153.1:34439)
0806 17:00:00.122762 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.122770 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.122798 (+ 28us) server_negotiation.cc:407] Connection header received
0806 17:00:00.122888 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.122892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.123061 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.123223 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:00.123539 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.124825 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.126190 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.126836 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.126960 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.127129 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.127306 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.127419 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":129,"threads_started":1}
I20260806 17:00:00.128415 22935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.121780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35427 (local address 127.0.0.1:37496)
0806 17:00:00.122537 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.122552 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.122648 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.123419 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.123423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.123444 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:00.123553 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.123559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.125057 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.125060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.126634 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.126646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.127945 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.127950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.128059 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.128110 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.128179 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.128259 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"mutex_wait_us":200,"thread_start_us":135,"threads_started":1}
I20260806 17:00:00.128950 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.122265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.7.153.3:35427)
0806 17:00:00.122915 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.122927 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.122951 (+ 24us) server_negotiation.cc:407] Connection header received
0806 17:00:00.123030 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.123036 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.123225 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.123417 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:00.123686 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.124848 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.126791 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.127620 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.127730 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.127878 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.128628 (+ 750us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.128779 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":147,"threads_started":1}
I20260806 17:00:00.129455 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.122296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34557 (local address 127.0.0.1:32952)
0806 17:00:00.122674 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.122688 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.122764 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.123622 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.123625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.123642 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:00.123736 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.123741 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.125133 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.125138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.126634 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.126646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.128760 (+ 2114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.128764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.129115 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.129145 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.129235 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.129317 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":118,"thread_start_us":86,"threads_started":1}
I20260806 17:00:00.129542 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.122717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32952 (local address 127.7.153.2:34557)
0806 17:00:00.123145 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.123155 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.123174 (+ 19us) server_negotiation.cc:407] Connection header received
0806 17:00:00.123243 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.123248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.123412 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.123544 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:00.123855 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.124971 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.126780 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.128447 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.128550 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.128676 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.129294 (+ 618us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.129402 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":139,"threads_started":1}
I20260806 17:00:00.131563 22852 tablet_service.cc:1467] Processing CreateTablet for tablet 57d70533fa11468fbc1816ad5cccb70d (DEFAULT_TABLE table=test-table [id=a377b17cd40c4987bb793bed93308fa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:00.131563 22566 tablet_service.cc:1467] Processing CreateTablet for tablet 57d70533fa11468fbc1816ad5cccb70d (DEFAULT_TABLE table=test-table [id=a377b17cd40c4987bb793bed93308fa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:00.131877 22709 tablet_service.cc:1467] Processing CreateTablet for tablet 57d70533fa11468fbc1816ad5cccb70d (DEFAULT_TABLE table=test-table [id=a377b17cd40c4987bb793bed93308fa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:00.132834 22566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57d70533fa11468fbc1816ad5cccb70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:00.132835 22852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57d70533fa11468fbc1816ad5cccb70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:00.132982 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57d70533fa11468fbc1816ad5cccb70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:00.140223 22938 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Bootstrap starting.
I20260806 17:00:00.141530 22939 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Bootstrap starting.
I20260806 17:00:00.143100 22938 tablet_bootstrap.cc:654] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:00.143600 22939 tablet_bootstrap.cc:654] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:00.144269 22938 log.cc:824] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:00.144315 22939 log.cc:824] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:00.145120 22940 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Bootstrap starting.
I20260806 17:00:00.146651 22938 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: No bootstrap required, opened a new log
I20260806 17:00:00.146699 22939 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: No bootstrap required, opened a new log
I20260806 17:00:00.146883 22938 ts_tablet_manager.cc:1397] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 17:00:00.146883 22939 ts_tablet_manager.cc:1397] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 17:00:00.148099 22940 tablet_bootstrap.cc:654] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:00.149194 22940 log.cc:824] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:00.150499 22938 raft_consensus.cc:348] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.150823 22938 raft_consensus.cc:374] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:00.150887 22938 raft_consensus.cc:729] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19ba89fbae774f7282fac054eb579601, State: Initialized, Role: FOLLOWER
I20260806 17:00:00.151823 22938 consensus_queue.cc:260] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.151926 22940 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: No bootstrap required, opened a new log
I20260806 17:00:00.152197 22940 ts_tablet_manager.cc:1397] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 17:00:00.152535 22939 raft_consensus.cc:348] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.152856 22939 raft_consensus.cc:374] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:00.152921 22939 raft_consensus.cc:729] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab3f518398d7424fb75a439a3ab26670, State: Initialized, Role: FOLLOWER
I20260806 17:00:00.153007 22938 ts_tablet_manager.cc:1428] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 17:00:00.153419 22781 heartbeater.cc:503] Master 127.7.153.62:34207 was elected leader, sending a full tablet report...
I20260806 17:00:00.153424 22939 consensus_queue.cc:260] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.154315 22939 ts_tablet_manager.cc:1428] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Time spent starting tablet: real 0.007s user 0.008s sys 0.001s
I20260806 17:00:00.154506 22637 heartbeater.cc:503] Master 127.7.153.62:34207 was elected leader, sending a full tablet report...
I20260806 17:00:00.158762 22940 raft_consensus.cc:348] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.159171 22940 raft_consensus.cc:374] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:00.159246 22940 raft_consensus.cc:729] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da82cfb1bff74113a6aa173d435be9ff, State: Initialized, Role: FOLLOWER
I20260806 17:00:00.159765 22940 consensus_queue.cc:260] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.160778 22920 heartbeater.cc:503] Master 127.7.153.62:34207 was elected leader, sending a full tablet report...
I20260806 17:00:00.161193 22940 ts_tablet_manager.cc:1428] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260806 17:00:00.206275 22944 raft_consensus.cc:482] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:00.206522 22944 raft_consensus.cc:504] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.207769 22944 leader_election.cc:288] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
I20260806 17:00:00.212116 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.208116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34439 (local address 127.7.153.2:57695)
0806 17:00:00.208843 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.208855 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.208977 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.209254 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.209256 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.209272 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:00.209390 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.209396 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.210113 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.210120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.210941 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.210951 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.211652 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.211655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.211755 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.211785 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.211875 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.211953 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":320,"thread_start_us":173,"threads_started":1}
I20260806 17:00:00.212095 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.208182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:57695 (local address 127.7.153.1:34439)
0806 17:00:00.208307 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.208312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.208942 (+ 630us) server_negotiation.cc:407] Connection header received
0806 17:00:00.209098 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.209101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.209156 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.209242 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:00.209498 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.209991 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.211079 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.211517 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.211641 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.211708 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.211891 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.211965 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 17:00:00.212410 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.208105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35427 (local address 127.7.153.2:47823)
0806 17:00:00.208227 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.208244 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.208352 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.208757 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.208761 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.208778 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:00.208895 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.208902 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.209885 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.209888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.211018 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.211030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.212030 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.212033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.212140 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.212161 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.212227 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.212294 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 17:00:00.212680 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.208211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:47823 (local address 127.7.153.3:35427)
0806 17:00:00.208355 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.208360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.208380 (+ 20us) server_negotiation.cc:407] Connection header received
0806 17:00:00.208466 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.208469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.208532 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.208613 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:00.209024 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.209753 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.211166 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.211813 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.211911 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.211973 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.212485 (+ 512us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.212575 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 17:00:00.213255 22586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d70533fa11468fbc1816ad5cccb70d" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab3f518398d7424fb75a439a3ab26670" is_pre_election: true
I20260806 17:00:00.213254 22873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d70533fa11468fbc1816ad5cccb70d" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da82cfb1bff74113a6aa173d435be9ff" is_pre_election: true
I20260806 17:00:00.213577 22586 raft_consensus.cc:2454] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 0.
I20260806 17:00:00.213577 22873 raft_consensus.cc:2454] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 0.
I20260806 17:00:00.214134 22659 leader_election.cc:302] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 19ba89fbae774f7282fac054eb579601, ab3f518398d7424fb75a439a3ab26670, da82cfb1bff74113a6aa173d435be9ff; no voters:
I20260806 17:00:00.214570 22944 raft_consensus.cc:2781] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:00:00.214666 22944 raft_consensus.cc:482] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:00:00.214720 22944 raft_consensus.cc:3037] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:00.215842 22944 raft_consensus.cc:504] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.216293 22944 leader_election.cc:288] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 election: Requested vote from peers ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
I20260806 17:00:00.216784 22873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d70533fa11468fbc1816ad5cccb70d" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da82cfb1bff74113a6aa173d435be9ff"
I20260806 17:00:00.216776 22586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d70533fa11468fbc1816ad5cccb70d" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab3f518398d7424fb75a439a3ab26670"
I20260806 17:00:00.216914 22586 raft_consensus.cc:3037] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:00.216936 22873 raft_consensus.cc:3037] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:00.218065 22873 raft_consensus.cc:2454] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 1.
I20260806 17:00:00.218277 22586 raft_consensus.cc:2454] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 1.
I20260806 17:00:00.218456 22662 leader_election.cc:302] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff; no voters:
I20260806 17:00:00.218657 22944 raft_consensus.cc:2781] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:00:00.218909 22944 raft_consensus.cc:686] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 1 LEADER]: Becoming Leader. State: Replica: 19ba89fbae774f7282fac054eb579601, State: Running, Role: LEADER
I20260806 17:00:00.219609 22944 consensus_queue.cc:237] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.223815 22433 catalog_manager.cc:5495] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19ba89fbae774f7282fac054eb579601 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "19ba89fbae774f7282fac054eb579601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260806 17:00:00.254158 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.250042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32954 (local address 127.7.153.2:34557)
0806 17:00:00.250207 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.250212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.250227 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:00:00.250420 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.250423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.250486 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.250676 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:00:00.250946 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.251459 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.252357 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.252573 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.252692 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.253132 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:00:00.253629 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:00:00.253738 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.253914 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.253992 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 17:00:00.261584 22586 raft_consensus.cc:1261] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Refusing update from remote peer 19ba89fbae774f7282fac054eb579601: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:00.261595 22873 raft_consensus.cc:1261] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Refusing update from remote peer 19ba89fbae774f7282fac054eb579601: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:00.262422 22948 consensus_queue.cc:1035] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:00.262643 22944 consensus_queue.cc:1035] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:00.273864 22953 mvcc.cc:205] Tried to move back new op lower bound from 7315601818661699584 to 7315601818503041024. Current Snapshot: MvccSnapshot[applied={T|T < 7315601818661699584 or (T in {7315601818661699584})}]
I20260806 17:00:00.281864 22428 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:00.282109 22428 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:00.285341 22428 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Sending DeleteTablet for 3 replicas of tablet 57d70533fa11468fbc1816ad5cccb70d
I20260806 17:00:00.286346 22566 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d70533fa11468fbc1816ad5cccb70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:00 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:54306
I20260806 17:00:00.286463 22852 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d70533fa11468fbc1816ad5cccb70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:00 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:37496
I20260806 17:00:00.286438 22709 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d70533fa11468fbc1816ad5cccb70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:00 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:32952
I20260806 17:00:00.286950 22963 tablet_replica.cc:330] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: stopping tablet replica
I20260806 17:00:00.287269 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22499
I20260806 17:00:00.287302 22963 raft_consensus.cc:2229] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:00.287683 22963 raft_consensus.cc:2258] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:00.288360 22964 tablet_replica.cc:330] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: stopping tablet replica
I20260806 17:00:00.288745 22964 raft_consensus.cc:2229] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:00.289080 22964 raft_consensus.cc:2258] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:00.290905 22964 ts_tablet_manager.cc:1905] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:00.292990 22965 tablet_replica.cc:330] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: stopping tablet replica
I20260806 17:00:00.293437 22965 raft_consensus.cc:2229] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:00:00.293962 22964 ts_tablet_manager.cc:1918] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:00.294103 22964 log.cc:1196] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/57d70533fa11468fbc1816ad5cccb70d
I20260806 17:00:00.294034 22965 raft_consensus.cc:2258] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:00.294524 22964 ts_tablet_manager.cc:1939] T 57d70533fa11468fbc1816ad5cccb70d P da82cfb1bff74113a6aa173d435be9ff: Deleting consensus metadata
I20260806 17:00:00.296120 22419 catalog_manager.cc:4841] TS da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): tablet 57d70533fa11468fbc1816ad5cccb70d (table test-table [id=a377b17cd40c4987bb793bed93308fa5]) successfully deleted
I20260806 17:00:00.296197 22965 ts_tablet_manager.cc:1905] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:00.299266 22965 ts_tablet_manager.cc:1918] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260806 17:00:00.299371 22416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:34439 (error 108)
I20260806 17:00:00.299518 22965 log.cc:1196] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/57d70533fa11468fbc1816ad5cccb70d
I20260806 17:00:00.299681 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22643
I20260806 17:00:00.303625 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.303306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34439 (local address 127.0.0.1:54496)
0806 17:00:00.303457 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.303538 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:34439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 17:00:00.303820 22416 catalog_manager.cc:4584] TS ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 57d70533fa11468fbc1816ad5cccb70d: Network error: Client connection negotiation failed: client connection to 127.7.153.1:34439: connect: Connection refused (error 111)
I20260806 17:00:00.308528 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22787
I20260806 17:00:00.311928 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.311482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34557 (local address 127.0.0.1:40452)
0806 17:00:00.311727 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.311804 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.2:34557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260806 17:00:00.317795 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22398
I20260806 17:00:00.327798 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34207
--webserver_interface=127.7.153.62
--webserver_port=41573
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:00.449427 22967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:00.449759 22967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:00.449805 22967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:00.454092 22967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:00:00.454173 22967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:00.454193 22967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:00.454210 22967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:00:00.454226 22967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:00:00.460078 22967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=41573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:00.461434 22967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:00.462569 22967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:00.478698 22974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:00.478719 22973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:00.478691 22976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:00.479247 22967 server_base.cc:1034] running on GCE node
I20260806 17:00:00.479928 22967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:00.481309 22967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:00.482483 22967 hybrid_clock.cc:648] HybridClock initialized: now 1786035600482463 us; error 35 us; skew 500 ppm
Aug 06 17:00:00 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035600, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:00.485872 22967 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:00:00.486931 22967 webserver.cc:460] Webserver started at http://127.7.153.62:41573/ using document root <none> and password file <none>
I20260806 17:00:00.487597 22967 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:00.487721 22967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:00.492161 22967 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:00.495187 22983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:00.496958 22967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:00.497165 22967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c2940d182ab54a799b8eacc2561bae45"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "5961ce8f319cd0e198ffffce949d6384"
server_key_iv: "c4f76f272623c43013e982ee0699ad8a"
server_key_version: "encryptionkey@0"
I20260806 17:00:00.497916 22967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:00.512918 22967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:00.517293 22967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:00.517586 22967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:00.525965 22967 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34207
I20260806 17:00:00.526350 23038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34207 every 8 connection(s)
I20260806 17:00:00.527263 22967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:00:00.532661 23039 sys_catalog.cc:263] Verifying existing consensus state
I20260806 17:00:00.535343 23039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap starting.
I20260806 17:00:00.536830 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 22967
I20260806 17:00:00.537416 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:34439
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:34207
--webserver_port=40147
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:00:00.554955 23039 log.cc:824] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:00.564822 23039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:00.565263 23039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap complete.
I20260806 17:00:00.569777 23039 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:00.570276 23039 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2940d182ab54a799b8eacc2561bae45, State: Initialized, Role: FOLLOWER
I20260806 17:00:00.570883 23039 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:00.571053 23039 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:00:00.571144 23039 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:00:00.571275 23039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 1 FOLLOWER]: Advancing to term 2
I20260806 17:00:00.573576 23039 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:00.573973 23039 leader_election.cc:302] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2940d182ab54a799b8eacc2561bae45; no voters:
I20260806 17:00:00.574384 23039 leader_election.cc:288] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 17:00:00.574450 23043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 17:00:00.574668 23043 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 LEADER]: Becoming Leader. State: Replica: c2940d182ab54a799b8eacc2561bae45, State: Running, Role: LEADER
I20260806 17:00:00.575011 23043 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:00.575790 23039 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:00:00.576737 23045 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c2940d182ab54a799b8eacc2561bae45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } } }
I20260806 17:00:00.576900 23045 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:00.576823 23044 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2940d182ab54a799b8eacc2561bae45. Latest consensus state: current_term: 2 leader_uuid: "c2940d182ab54a799b8eacc2561bae45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } } }
I20260806 17:00:00.577041 23044 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:00.581605 23058 catalog_manager.cc:1259] Loaded cluster ID: df4db4c73f914d638acce8ec3c77c654
I20260806 17:00:00.581694 23058 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: loading cluster ID for follower catalog manager: success
W20260806 17:00:00.582757 23058 catalog_manager.cc:1576] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260806 17:00:00.582844 23058 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260806 17:00:00.582919 23051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:00:00.585139 23051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:00:00.585687 23051 catalog_manager.cc:1259] Loaded cluster ID: df4db4c73f914d638acce8ec3c77c654
I20260806 17:00:00.585752 23051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:00:00.586850 23051 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 17:00:00.591816 23051 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 17:00:00.599036 23051 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:00:00.599983 23051 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Loaded TSK: 0
I20260806 17:00:00.601305 23051 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 17:00:00.670207 23041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:00.670575 23041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:00.670672 23041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:00.675403 23041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:00.675510 23041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:00.675654 23041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:00:00.681766 23041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:34439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=40147
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:00.683007 23041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:00.684172 23041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:00.696470 23070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:00.696470 23068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:00.696542 23067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:00.696923 23041 server_base.cc:1034] running on GCE node
I20260806 17:00:00.697633 23041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:00.698374 23041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:00.699594 23041 hybrid_clock.cc:648] HybridClock initialized: now 1786035600699569 us; error 53 us; skew 500 ppm
Aug 06 17:00:00 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035600, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:00.702971 23041 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:00:00.704171 23041 webserver.cc:460] Webserver started at http://127.7.153.1:40147/ using document root <none> and password file <none>
I20260806 17:00:00.704879 23041 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:00.705008 23041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:00.709599 23041 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:00.712200 23077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:00.713939 23041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 17:00:00.714157 23041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "ab3f518398d7424fb75a439a3ab26670"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "0e626660e8e6f8d5defa06d0dfac4c22"
server_key_iv: "c94edc577ee3274ff13773279b4c29c8"
server_key_version: "encryptionkey@0"
I20260806 17:00:00.714808 23041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:00.725672 23041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:00.729760 23041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:00.730038 23041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:00.731003 23041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:00.732887 23085 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 17:00:00.739722 23041 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 17:00:00.739868 23041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260806 17:00:00.739970 23041 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 17:00:00.742146 23041 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 17:00:00.742252 23041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 17:00:00.742574 23085 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Bootstrap starting.
I20260806 17:00:00.755316 23041 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:34439
I20260806 17:00:00.755399 23200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:34439 every 8 connection(s)
I20260806 17:00:00.756656 23041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:00:00.765239 23085 log.cc:824] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:00.766914 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23041
I20260806 17:00:00.767419 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:34557
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:34207
--webserver_port=41999
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 17:00:00 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035600, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:00.776609 23085 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:00.777386 23085 tablet_bootstrap.cc:492] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Bootstrap complete.
I20260806 17:00:00.778450 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.759119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:37163 (local address 127.7.153.62:34207)
0806 17:00:00.759703 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.759723 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.759776 (+ 53us) server_negotiation.cc:407] Connection header received
0806 17:00:00.761018 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.761036 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.761509 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.762012 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:00.763255 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.765141 (+ 1886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.767494 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.768152 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.768634 (+ 482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.772418 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:00.772425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:00.772439 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:00.772482 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:00.774467 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.775142 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.775147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.775151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.775282 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.775671 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.775674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.775676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.776146 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:00.776292 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.777026 (+ 734us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.777484 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":163,"threads_started":1}
I20260806 17:00:00.779073 23085 ts_tablet_manager.cc:1397] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Time spent bootstrapping tablet: real 0.037s user 0.029s sys 0.004s
I20260806 17:00:00.780001 23203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.758967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:37163)
0806 17:00:00.759529 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.759590 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.760456 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.762090 (+ 1634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.762098 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.762535 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:00.763032 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.763049 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.765605 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.765612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.767112 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.767140 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.768883 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.768889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.769160 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.770110 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:00.770138 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:00.772107 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:00.774647 (+ 2540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:00.774655 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:00.774671 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:00.774984 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:00.775395 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:00.775398 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:00.775400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:00.775549 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:00.776279 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:00.776285 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:00.776575 (+ 290us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.778896 (+ 2321us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.779277 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":166,"threads_started":1}
I20260806 17:00:00.782570 23201 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34207
I20260806 17:00:00.782876 23201 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:00.783473 23201 heartbeater.cc:511] Master 127.7.153.62:34207 requested a full tablet report, sending...
I20260806 17:00:00.783417 23085 raft_consensus.cc:348] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.784178 23085 raft_consensus.cc:729] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab3f518398d7424fb75a439a3ab26670, State: Initialized, Role: FOLLOWER
I20260806 17:00:00.784850 23085 consensus_queue.cc:260] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } }
I20260806 17:00:00.786243 23085 ts_tablet_manager.cc:1428] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 17:00:00.788398 23001 ts_manager.cc:194] Registered new tserver with Master: ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439)
I20260806 17:00:00.792658 23001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:37163
I20260806 17:00:00.795706 23201 heartbeater.cc:503] Master 127.7.153.62:34207 was elected leader, sending a full tablet report...
Aug 06 17:00:00 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035600, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 17:00:00.806166 23208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.791846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34439 (local address 127.0.0.1:54500)
0806 17:00:00.792919 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:00.792971 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:00.793150 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:00.793967 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:00.793975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:00.794999 (+ 1024us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:00.795389 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.795409 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.796998 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.797002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.797970 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:00.797981 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.798805 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.798807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:00.798912 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.799610 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:00.799623 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:00.801260 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:00.803841 (+ 2581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:00.803850 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:00.803855 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:00.804123 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:00.804495 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:00.804498 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:00.804500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:00.804594 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:00.805431 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:00.805436 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:00.805587 (+ 151us) client_negotiation.cc:769] Sending connection context
0806 17:00:00.805798 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 17:00:00.806002 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":126,"threads_started":1}
I20260806 17:00:00.806268 23209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:00.792010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54500 (local address 127.7.153.1:34439)
0806 17:00:00.792583 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:00.792597 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:00.793097 (+ 500us) server_negotiation.cc:407] Connection header received
0806 17:00:00.793331 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:00.793337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:00.793580 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:00.793740 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:00.795600 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.796860 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.798092 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:00.798615 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:00.798732 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:00.801441 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:00.801456 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:00.801472 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:00.801511 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:00.803648 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.804255 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.804262 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.804264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.804368 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:00.804909 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:00.804913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:00.804914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:00.805275 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:00.805431 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:00.805905 (+ 474us) server_negotiation.cc:299] Negotiation successful
0806 17:00:00.806098 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":142,"threads_started":1}
I20260806 17:00:00.807430 23131 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d70533fa11468fbc1816ad5cccb70d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:00 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:54500
I20260806 17:00:00.808382 23210 tablet_replica.cc:330] stopping tablet replica
I20260806 17:00:00.808776 23210 raft_consensus.cc:2229] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:00.809059 23210 raft_consensus.cc:2258] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:00.810129 23210 ts_tablet_manager.cc:1905] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:00.814844 23210 ts_tablet_manager.cc:1918] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:00.815024 23210 log.cc:1196] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/57d70533fa11468fbc1816ad5cccb70d
I20260806 17:00:00.815577 23210 ts_tablet_manager.cc:1939] T 57d70533fa11468fbc1816ad5cccb70d P ab3f518398d7424fb75a439a3ab26670: Deleting consensus metadata
I20260806 17:00:00.818729 22984 catalog_manager.cc:4841] TS ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439): tablet 57d70533fa11468fbc1816ad5cccb70d (table test-table [id=a377b17cd40c4987bb793bed93308fa5]) successfully deleted
W20260806 17:00:00.965878 23206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:00.966563 23206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:00.966719 23206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:00.974556 23206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:00.974829 23206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:00.975032 23206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:00:00.986095 23206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:34557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=41999
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:00.988464 23206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:00.991317 23206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:01.012751 23218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:01.012770 23215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:01.013059 23216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:01.013188 23206 server_base.cc:1034] running on GCE node
I20260806 17:00:01.014086 23206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:01.015287 23206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:01.016794 23206 hybrid_clock.cc:648] HybridClock initialized: now 1786035601016744 us; error 71 us; skew 500 ppm
Aug 06 17:00:01 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035601, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:01.023175 23206 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:00:01.025189 23206 webserver.cc:460] Webserver started at http://127.7.153.2:41999/ using document root <none> and password file <none>
I20260806 17:00:01.026197 23206 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:01.026335 23206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:01.033993 23206 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 17:00:01.038399 23226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:01.041049 23206 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 17:00:01.041319 23206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "19ba89fbae774f7282fac054eb579601"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "ff932b576716aea3335c6c5cfa412f84"
server_key_iv: "560be6acfb2761e1433b6e71ab32df7b"
server_key_version: "encryptionkey@0"
I20260806 17:00:01.042343 23206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:01.082980 23206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:01.090260 23206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:01.090694 23206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:01.091910 23206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:01.094272 23233 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260806 17:00:01.102811 23233 ts_tablet_manager.cc:1852] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260806 17:00:01.103649 23233 ts_tablet_manager.cc:1905] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:01.113562 23233 ts_tablet_manager.cc:1918] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:01.113940 23233 log.cc:1196] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/57d70533fa11468fbc1816ad5cccb70d
I20260806 17:00:01.114715 23233 ts_tablet_manager.cc:1939] T 57d70533fa11468fbc1816ad5cccb70d P 19ba89fbae774f7282fac054eb579601: Deleting consensus metadata
I20260806 17:00:01.115356 23206 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 17:00:01.115478 23206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.022s user 0.001s sys 0.000s
I20260806 17:00:01.115582 23206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:01.115638 23206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:01.138762 23206 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34557
I20260806 17:00:01.138825 23346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34557 every 8 connection(s)
I20260806 17:00:01.141376 23206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:00:01.145409 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23206
I20260806 17:00:01.146211 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:35427
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:34207
--webserver_port=44143
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 17:00:01 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035601, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:01.175539 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.145384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:44539 (local address 127.7.153.62:34207)
0806 17:00:01.145716 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.145726 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.148785 (+ 3059us) server_negotiation.cc:407] Connection header received
0806 17:00:01.151644 (+ 2859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.151653 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.151841 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.152079 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:01.155899 (+ 3820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.157085 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.161056 (+ 3971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.161517 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.161763 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.168151 (+ 6388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:01.168157 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:01.168160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:01.168225 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:01.171074 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:01.172348 (+ 1274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:01.172357 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:01.172358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:01.172482 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:01.173259 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:01.173263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:01.173265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:01.173638 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:01.173865 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.174885 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.175227 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260806 17:00:01.177760 23350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.146344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:44539)
0806 17:00:01.148265 (+ 1921us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.148411 (+ 146us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:01.151105 (+ 2694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:01.152435 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:01.152449 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:01.153783 (+ 1334us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:01.155380 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.155436 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.157449 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.157465 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.160629 (+ 3164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.160677 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.161904 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.161923 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.162485 (+ 562us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.163828 (+ 1343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:01.163899 (+ 71us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:01.167669 (+ 3770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:01.171424 (+ 3755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:01.171447 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:01.171480 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:01.172103 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:01.172666 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:01.172682 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:01.172684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:01.173038 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:01.173873 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:01.173885 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:01.174411 (+ 526us) client_negotiation.cc:769] Sending connection context
0806 17:00:01.174786 (+ 375us) client_negotiation.cc:240] Negotiation successful
0806 17:00:01.175510 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1060,"thread_start_us":539,"threads_started":1}
I20260806 17:00:01.180756 23347 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34207
I20260806 17:00:01.181249 23347 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:01.182190 23347 heartbeater.cc:511] Master 127.7.153.62:34207 requested a full tablet report, sending...
I20260806 17:00:01.185184 23001 ts_manager.cc:194] Registered new tserver with Master: 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557)
I20260806 17:00:01.186594 23001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:44539
W20260806 17:00:01.374864 23351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:01.375386 23351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:01.375458 23351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:01.382208 23351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:01.382359 23351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:01.382476 23351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:00:01.391659 23351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:35427
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=44143
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:01.394004 23351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:01.395884 23351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:01.414040 23358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:01.414196 23360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:01.414083 23357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:01.414628 23351 server_base.cc:1034] running on GCE node
I20260806 17:00:01.415609 23351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:01.416767 23351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:01.418161 23351 hybrid_clock.cc:648] HybridClock initialized: now 1786035601418094 us; error 114 us; skew 500 ppm
Aug 06 17:00:01 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035601, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:01.423441 23351 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:00:01.425251 23351 webserver.cc:460] Webserver started at http://127.7.153.3:44143/ using document root <none> and password file <none>
I20260806 17:00:01.426281 23351 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:01.426551 23351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:01.435166 23351 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 17:00:01.439155 23367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:01.441583 23351 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 17:00:01.441890 23351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "da82cfb1bff74113a6aa173d435be9ff"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "e304fcf87d4feea1a91dd3aa9dfa1551"
server_key_iv: "e3a28c8e20e7b3caf54a25bad6fc96c9"
server_key_version: "encryptionkey@0"
I20260806 17:00:01.442816 23351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:01.467423 23351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:01.473982 23351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:01.474382 23351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:01.475565 23351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:01.477428 23351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:01.477506 23351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:01.477634 23351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:01.477706 23351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:01.497334 23351 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:35427
I20260806 17:00:01.497367 23489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:35427 every 8 connection(s)
I20260806 17:00:01.499800 23351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:00:01.506583 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23351
Aug 06 17:00:01 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035601, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:01.523710 23493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.508038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53308 (local address 127.7.153.62:34207)
0806 17:00:01.508500 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.508507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.509071 (+ 564us) server_negotiation.cc:407] Connection header received
0806 17:00:01.509371 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.509374 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.509451 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.509603 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:01.510891 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.511733 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.513255 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.513638 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.513862 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.516806 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:01.516812 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:01.516814 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:01.516857 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:01.519260 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:01.520258 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:01.520261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:01.520263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:01.520438 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:01.521074 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:01.521089 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:01.521093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:01.521450 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:01.521812 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.522843 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.523349 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":123,"threads_started":1}
I20260806 17:00:01.528192 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.503827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:42107 (local address 127.7.153.62:34207)
0806 17:00:01.504091 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.504095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.506403 (+ 2308us) server_negotiation.cc:407] Connection header received
0806 17:00:01.508298 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.508304 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.508423 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.508627 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:01.511042 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.511876 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.514171 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.514555 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.514796 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.520300 (+ 5504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:01.520306 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:01.520309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:01.520385 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:01.523493 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:01.524823 (+ 1330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:01.524830 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:01.524831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:01.524992 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:01.525655 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:01.525659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:01.525660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:01.526096 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:01.526252 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.527660 (+ 1408us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.527926 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 17:00:01.530066 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.504627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:42107)
0806 17:00:01.506130 (+ 1503us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.506209 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:01.507751 (+ 1542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:01.509039 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:01.509052 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:01.509789 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:01.510772 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.510798 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.512143 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.512148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.513884 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.513907 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.514870 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.514876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.515203 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.516251 (+ 1048us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:01.516274 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:01.519881 (+ 3607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:01.523717 (+ 3836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:01.523734 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:01.523762 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:01.524593 (+ 831us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:01.525130 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:01.525135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:01.525137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:01.525471 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:01.526357 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:01.526377 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:01.527098 (+ 721us) client_negotiation.cc:769] Sending connection context
0806 17:00:01.527549 (+ 451us) client_negotiation.cc:240] Negotiation successful
0806 17:00:01.528262 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1105,"thread_start_us":310,"threads_started":1}
I20260806 17:00:01.532034 23490 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34207
I20260806 17:00:01.532469 23490 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:01.533558 23490 heartbeater.cc:511] Master 127.7.153.62:34207 requested a full tablet report, sending...
I20260806 17:00:01.535607 23001 ts_manager.cc:194] Registered new tserver with Master: da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
I20260806 17:00:01.536509 23001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:42107
I20260806 17:00:01.540609 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:00:01.548380 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.541675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.7.153.62:34207)
0806 17:00:01.541882 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.541890 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.542234 (+ 344us) server_negotiation.cc:407] Connection header received
0806 17:00:01.542476 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.542478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.542665 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.542817 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:00:01.543245 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.543959 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.545889 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.546237 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.546372 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.546881 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:00:01.547592 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:00:01.547750 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.548000 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.548091 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 17:00:01.549666 23001 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:53318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:00:01.555670 23001 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:00:01.571910 23131 tablet_service.cc:1467] Processing CreateTablet for tablet 946cc631d093463596cf31b161a18764 (DEFAULT_TABLE table=test-table [id=33375cb919734e5bb73301797324f27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:01.573603 23131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946cc631d093463596cf31b161a18764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:01.580536 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.569939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35427 (local address 127.0.0.1:60190)
0806 17:00:01.570433 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.570463 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:01.570681 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:01.572804 (+ 2123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:01.572828 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:01.572871 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:01.573178 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.573187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.575383 (+ 2196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.575386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.577203 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.577237 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.579648 (+ 2411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.579653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.579801 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.579898 (+ 97us) client_negotiation.cc:769] Sending connection context
0806 17:00:01.580032 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 17:00:01.580180 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":92,"thread_start_us":191,"threads_started":1}
I20260806 17:00:01.580653 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.570848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60190 (local address 127.7.153.3:35427)
0806 17:00:01.571764 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.571793 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.571851 (+ 58us) server_negotiation.cc:407] Connection header received
0806 17:00:01.571948 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.571953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.572280 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.572638 (+ 358us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:01.573390 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.575077 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.577542 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.579407 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.579683 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.580022 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.580142 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.580364 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":189,"threads_started":1}
I20260806 17:00:01.581111 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.569200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34557 (local address 127.0.0.1:40468)
0806 17:00:01.569938 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.569971 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:01.570188 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:01.572880 (+ 2692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:01.572889 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:01.572979 (+ 90us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:01.573289 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.573303 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.576607 (+ 3304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.576611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.578561 (+ 1950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.578581 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.580442 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.580447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.580630 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.580664 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 17:00:01.580804 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 17:00:01.580943 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"mutex_wait_us":36,"spinlock_wait_cycles":1920,"thread_start_us":231,"threads_started":1}
I20260806 17:00:01.581598 23503 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Bootstrap starting.
I20260806 17:00:01.582741 23500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.569613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40468 (local address 127.7.153.2:34557)
0806 17:00:01.571362 (+ 1749us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.571408 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.571474 (+ 66us) server_negotiation.cc:407] Connection header received
0806 17:00:01.571885 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.571893 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.572386 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.573646 (+ 1260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:01.574391 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.576295 (+ 1904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.578820 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.580182 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.581957 (+ 1775us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.582193 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.582311 (+ 118us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.582475 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":158,"threads_started":1}
I20260806 17:00:01.583702 23503 tablet_bootstrap.cc:654] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:01.586639 23503 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: No bootstrap required, opened a new log
I20260806 17:00:01.585685 23278 tablet_service.cc:1467] Processing CreateTablet for tablet 946cc631d093463596cf31b161a18764 (DEFAULT_TABLE table=test-table [id=33375cb919734e5bb73301797324f27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:01.586853 23503 ts_tablet_manager.cc:1397] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260806 17:00:01.586585 23418 tablet_service.cc:1467] Processing CreateTablet for tablet 946cc631d093463596cf31b161a18764 (DEFAULT_TABLE table=test-table [id=33375cb919734e5bb73301797324f27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:01.588023 23278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946cc631d093463596cf31b161a18764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:01.587913 23503 raft_consensus.cc:348] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.588506 23418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946cc631d093463596cf31b161a18764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:01.588536 23503 raft_consensus.cc:374] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:01.588649 23503 raft_consensus.cc:729] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab3f518398d7424fb75a439a3ab26670, State: Initialized, Role: FOLLOWER
I20260806 17:00:01.589097 23503 consensus_queue.cc:260] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.589972 23503 ts_tablet_manager.cc:1428] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:01.598657 23233 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Bootstrap starting.
I20260806 17:00:01.603641 23233 tablet_bootstrap.cc:654] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:01.604112 23506 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Bootstrap starting.
I20260806 17:00:01.605383 23233 log.cc:824] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:01.608986 23506 tablet_bootstrap.cc:654] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:01.609067 23233 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: No bootstrap required, opened a new log
I20260806 17:00:01.609371 23233 ts_tablet_manager.cc:1397] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260806 17:00:01.610385 23506 log.cc:824] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:01.613842 23506 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: No bootstrap required, opened a new log
I20260806 17:00:01.614230 23506 ts_tablet_manager.cc:1397] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 17:00:01.614435 23233 raft_consensus.cc:348] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.614869 23233 raft_consensus.cc:374] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:01.614995 23233 raft_consensus.cc:729] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19ba89fbae774f7282fac054eb579601, State: Initialized, Role: FOLLOWER
I20260806 17:00:01.615763 23233 consensus_queue.cc:260] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.617038 23347 heartbeater.cc:503] Master 127.7.153.62:34207 was elected leader, sending a full tablet report...
I20260806 17:00:01.617803 23233 ts_tablet_manager.cc:1428] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 17:00:01.620630 23506 raft_consensus.cc:348] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.621315 23506 raft_consensus.cc:374] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:01.621424 23506 raft_consensus.cc:729] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da82cfb1bff74113a6aa173d435be9ff, State: Initialized, Role: FOLLOWER
I20260806 17:00:01.621980 23509 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:01.622359 23509 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.622416 23506 consensus_queue.cc:260] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.623584 23490 heartbeater.cc:503] Master 127.7.153.62:34207 was elected leader, sending a full tablet report...
I20260806 17:00:01.624464 23506 ts_tablet_manager.cc:1428] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260806 17:00:01.624609 23509 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427), ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439)
I20260806 17:00:01.632436 23350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.625079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35427 (local address 127.7.153.2:46319)
0806 17:00:01.625398 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.625431 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:01.625581 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:01.626075 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:01.626080 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:01.626110 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:01.626314 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.626323 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.627798 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.627812 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.629895 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.629919 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.631628 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.631633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.631834 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.631892 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 17:00:01.632102 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 17:00:01.632269 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196}
I20260806 17:00:01.633177 23502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.625059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:46319 (local address 127.7.153.3:35427)
0806 17:00:01.625465 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.625471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.625503 (+ 32us) server_negotiation.cc:407] Connection header received
0806 17:00:01.625821 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.625826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.625932 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.626057 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:01.626548 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.627650 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.630126 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.631135 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.631358 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.631494 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.632806 (+ 1312us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.632991 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270}
I20260806 17:00:01.633962 23511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.625088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34439 (local address 127.7.153.2:41561)
0806 17:00:01.626238 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.626257 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:01.626499 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:01.627031 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:01.627034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:01.627061 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:01.627277 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.627292 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.629676 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.629682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.631711 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:01.631730 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.633222 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.633229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:01.633419 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.633481 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 17:00:01.633638 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 17:00:01.633785 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":25,"thread_start_us":197,"threads_started":1}
I20260806 17:00:01.634053 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.625833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:41561 (local address 127.7.153.1:34439)
0806 17:00:01.626243 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.626270 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.626417 (+ 147us) server_negotiation.cc:407] Connection header received
0806 17:00:01.626705 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.626712 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.626805 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.627008 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:01.627437 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.629495 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.631915 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.632990 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.633158 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.633499 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.633645 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.633833 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":111,"threads_started":1}
I20260806 17:00:01.634246 23441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946cc631d093463596cf31b161a18764" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da82cfb1bff74113a6aa173d435be9ff" is_pre_election: true
I20260806 17:00:01.634790 23441 raft_consensus.cc:2454] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 0.
I20260806 17:00:01.634842 23151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946cc631d093463596cf31b161a18764" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab3f518398d7424fb75a439a3ab26670" is_pre_election: true
I20260806 17:00:01.635275 23151 raft_consensus.cc:2454] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 0.
I20260806 17:00:01.635812 23230 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff; no voters:
I20260806 17:00:01.636332 23509 raft_consensus.cc:2781] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:00:01.636461 23509 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:00:01.636533 23509 raft_consensus.cc:3037] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:01.638248 23509 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.638854 23509 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 election: Requested vote from peers da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427), ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439)
I20260806 17:00:01.639434 23441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946cc631d093463596cf31b161a18764" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da82cfb1bff74113a6aa173d435be9ff"
I20260806 17:00:01.639495 23151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946cc631d093463596cf31b161a18764" candidate_uuid: "19ba89fbae774f7282fac054eb579601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab3f518398d7424fb75a439a3ab26670"
I20260806 17:00:01.639714 23151 raft_consensus.cc:3037] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:01.639693 23441 raft_consensus.cc:3037] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:01.642027 23441 raft_consensus.cc:2454] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 1.
I20260806 17:00:01.642027 23151 raft_consensus.cc:2454] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19ba89fbae774f7282fac054eb579601 in term 1.
I20260806 17:00:01.642629 23227 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19ba89fbae774f7282fac054eb579601, ab3f518398d7424fb75a439a3ab26670; no voters:
I20260806 17:00:01.643093 23509 raft_consensus.cc:2781] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:00:01.643580 23509 raft_consensus.cc:686] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 1 LEADER]: Becoming Leader. State: Replica: 19ba89fbae774f7282fac054eb579601, State: Running, Role: LEADER
W20260806 17:00:01.643641 23349 tablet.cc:2369] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 17:00:01.644258 23509 consensus_queue.cc:237] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:01.650791 23001 catalog_manager.cc:5495] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19ba89fbae774f7282fac054eb579601 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "19ba89fbae774f7282fac054eb579601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } health_report { overall_health: UNKNOWN } } }
I20260806 17:00:01.677603 23500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.670884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40470 (local address 127.7.153.2:34557)
0806 17:00:01.671116 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:01.671124 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:01.671165 (+ 41us) server_negotiation.cc:407] Connection header received
0806 17:00:01.671495 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:01.671497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:01.671602 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:01.671826 (+ 224us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:00:01.672207 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.673091 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.674433 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:01.674749 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:01.674966 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:01.675501 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:00:01.676406 (+ 905us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:00:01.676625 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:01.677111 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 17:00:01.677281 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 17:00:01.688483 23441 raft_consensus.cc:1261] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Refusing update from remote peer 19ba89fbae774f7282fac054eb579601: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:01.688474 23151 raft_consensus.cc:1261] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Refusing update from remote peer 19ba89fbae774f7282fac054eb579601: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:01.690019 23514 consensus_queue.cc:1035] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:01.690392 23509 consensus_queue.cc:1035] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:01.702692 23516 mvcc.cc:205] Tried to move back new op lower bound from 7315601824503308288 to 7315601824341086208. Current Snapshot: MvccSnapshot[applied={T|T < 7315601824503308288}]
I20260806 17:00:01.711056 23518 mvcc.cc:205] Tried to move back new op lower bound from 7315601824503308288 to 7315601824341086208. Current Snapshot: MvccSnapshot[applied={T|T < 7315601824503308288}]
I20260806 17:00:01.722196 22999 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:53318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:01.722568 22999 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:53318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:01.727375 22999 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Sending DeleteTablet for 3 replicas of tablet 946cc631d093463596cf31b161a18764
I20260806 17:00:01.728860 23131 tablet_service.cc:1514] Processing DeleteTablet for tablet 946cc631d093463596cf31b161a18764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:01 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:54500
I20260806 17:00:01.729104 23418 tablet_service.cc:1514] Processing DeleteTablet for tablet 946cc631d093463596cf31b161a18764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:01 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:60190
I20260806 17:00:01.729422 23278 tablet_service.cc:1514] Processing DeleteTablet for tablet 946cc631d093463596cf31b161a18764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:01 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40468
I20260806 17:00:01.730230 23526 tablet_replica.cc:330] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: stopping tablet replica
I20260806 17:00:01.730378 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 23041
I20260806 17:00:01.732477 23526 raft_consensus.cc:2229] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:01.733250 23526 raft_consensus.cc:2258] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:01.734361 23527 tablet_replica.cc:330] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: stopping tablet replica
I20260806 17:00:01.734929 23527 raft_consensus.cc:2229] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:00:01.735754 23527 raft_consensus.cc:2258] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:01.738300 23526 ts_tablet_manager.cc:1905] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:01.740615 23527 ts_tablet_manager.cc:1905] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:01.744163 23526 ts_tablet_manager.cc:1918] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:01.744488 23526 log.cc:1196] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/946cc631d093463596cf31b161a18764
I20260806 17:00:01.745280 23526 ts_tablet_manager.cc:1939] T 946cc631d093463596cf31b161a18764 P da82cfb1bff74113a6aa173d435be9ff: Deleting consensus metadata
I20260806 17:00:01.746145 23527 ts_tablet_manager.cc:1918] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:01.746383 23527 log.cc:1196] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/946cc631d093463596cf31b161a18764
I20260806 17:00:01.747022 23527 ts_tablet_manager.cc:1939] T 946cc631d093463596cf31b161a18764 P 19ba89fbae774f7282fac054eb579601: Deleting consensus metadata
I20260806 17:00:01.748620 22987 catalog_manager.cc:4841] TS da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): tablet 946cc631d093463596cf31b161a18764 (table test-table [id=33375cb919734e5bb73301797324f27f]) successfully deleted
I20260806 17:00:01.749428 22987 catalog_manager.cc:4841] TS 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557): tablet 946cc631d093463596cf31b161a18764 (table test-table [id=33375cb919734e5bb73301797324f27f]) successfully deleted
W20260806 17:00:01.749816 22984 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:34439 (error 108)
I20260806 17:00:01.750635 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 23206
I20260806 17:00:01.756237 23499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:01.755778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34439 (local address 127.0.0.1:54512)
0806 17:00:01.755988 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:01.756118 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:34439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 17:00:01.756665 22984 catalog_manager.cc:4584] TS ab3f518398d7424fb75a439a3ab26670 (127.7.153.1:34439): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 946cc631d093463596cf31b161a18764: Network error: Client connection negotiation failed: client connection to 127.7.153.1:34439: connect: Connection refused (error 111)
I20260806 17:00:01.764098 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 23351
I20260806 17:00:01.778301 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 22967
I20260806 17:00:01.794030 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34207
--webserver_interface=127.7.153.62
--webserver_port=41573
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:02.016605 23529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:02.017382 23529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:02.017571 23529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:02.024935 23529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:00:02.025122 23529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:02.025192 23529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:02.025303 23529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:00:02.025410 23529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:00:02.035776 23529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=41573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:02.038143 23529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:02.040338 23529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 17:00:02.057197 23529 server_base.cc:1034] running on GCE node
W20260806 17:00:02.057119 23535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:02.057080 23537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:02.057076 23534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:02.058753 23529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:02.061097 23529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:02.062467 23529 hybrid_clock.cc:648] HybridClock initialized: now 1786035602062432 us; error 71 us; skew 500 ppm
Aug 06 17:00:02 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035602, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:02.068341 23529 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:00:02.070216 23529 webserver.cc:460] Webserver started at http://127.7.153.62:41573/ using document root <none> and password file <none>
I20260806 17:00:02.071314 23529 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:02.071436 23529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:02.079002 23529 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 17:00:02.084925 23544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.088335 23529 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260806 17:00:02.088689 23529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c2940d182ab54a799b8eacc2561bae45"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "5961ce8f319cd0e198ffffce949d6384"
server_key_iv: "c4f76f272623c43013e982ee0699ad8a"
server_key_version: "encryptionkey@0"
I20260806 17:00:02.089883 23529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:02.118558 23529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:02.125979 23529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:02.126446 23529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:02.145430 23529 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34207
I20260806 17:00:02.146100 23601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34207 every 8 connection(s)
I20260806 17:00:02.148919 23529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:00:02.152022 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23529
I20260806 17:00:02.153017 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:34439
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:34207
--webserver_port=40147
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:00:02.159021 23602 sys_catalog.cc:263] Verifying existing consensus state
I20260806 17:00:02.165025 23602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap starting.
I20260806 17:00:02.204149 23602 log.cc:824] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:02.220044 23602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:02.220636 23602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45: Bootstrap complete.
I20260806 17:00:02.226995 23602 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:02.227629 23602 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2940d182ab54a799b8eacc2561bae45, State: Initialized, Role: FOLLOWER
I20260806 17:00:02.228241 23602 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:02.228415 23602 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:00:02.228485 23602 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:00:02.228590 23602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 2 FOLLOWER]: Advancing to term 3
I20260806 17:00:02.231559 23602 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:02.231992 23602 leader_election.cc:302] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2940d182ab54a799b8eacc2561bae45; no voters:
I20260806 17:00:02.232402 23602 leader_election.cc:288] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 17:00:02.232581 23606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 17:00:02.232908 23606 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [term 3 LEADER]: Becoming Leader. State: Replica: c2940d182ab54a799b8eacc2561bae45, State: Running, Role: LEADER
I20260806 17:00:02.233254 23606 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } }
I20260806 17:00:02.233863 23602 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:00:02.234771 23607 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c2940d182ab54a799b8eacc2561bae45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } } }
I20260806 17:00:02.234913 23607 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:02.235248 23608 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2940d182ab54a799b8eacc2561bae45. Latest consensus state: current_term: 3 leader_uuid: "c2940d182ab54a799b8eacc2561bae45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2940d182ab54a799b8eacc2561bae45" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34207 } } }
I20260806 17:00:02.235343 23608 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2940d182ab54a799b8eacc2561bae45 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:02.236102 23613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:00:02.241777 23613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:00:02.242555 23613 catalog_manager.cc:1259] Loaded cluster ID: df4db4c73f914d638acce8ec3c77c654
I20260806 17:00:02.242642 23613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 17:00:02.244058 23613 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fcdb98849ad google::LogMessage::Fail() at ??:0
@ 0x7fcdb988788a google::LogMessage::SendToLog() at ??:0
@ 0x7fcdb98844de google::LogMessage::Flush() at ??:0
@ 0x7fcdb9885a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fcdc41c3fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fcdc41c4d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fcdc41c1579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fcdc4205640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fcdbbad63d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fcdbbad6c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fcdbbad83f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fcdbbac7512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcdbd10b6db start_thread at ??:0
@ 0x7fcdb838261f clone at ??:0
W20260806 17:00:02.354704 23604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:02.355007 23604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:02.355065 23604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:02.359464 23604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:02.359546 23604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:02.359611 23604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:00:02.365743 23604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:34439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=40147
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:02.367071 23604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:02.368255 23604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:02.379293 23648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:02.379308 23649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:02.379496 23604 server_base.cc:1034] running on GCE node
W20260806 17:00:02.379667 23651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:02.380126 23604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:02.381006 23604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:02.382247 23604 hybrid_clock.cc:648] HybridClock initialized: now 1786035602382214 us; error 53 us; skew 500 ppm
Aug 06 17:00:02 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035602, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:02.385985 23604 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:00:02.387400 23604 webserver.cc:460] Webserver started at http://127.7.153.1:40147/ using document root <none> and password file <none>
I20260806 17:00:02.388238 23604 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:02.388370 23604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:02.393415 23604 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:02.396075 23658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.397635 23604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:02.397796 23604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "ab3f518398d7424fb75a439a3ab26670"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "0e626660e8e6f8d5defa06d0dfac4c22"
server_key_iv: "c94edc577ee3274ff13773279b4c29c8"
server_key_version: "encryptionkey@0"
I20260806 17:00:02.398417 23604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:02.415699 23604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:02.419464 23604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:02.419701 23604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:02.420388 23604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:02.421741 23665 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 17:00:02.427219 23604 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 17:00:02.427354 23604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260806 17:00:02.427451 23604 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 17:00:02.430060 23604 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 17:00:02.430171 23604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:02.430509 23665 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Bootstrap starting.
I20260806 17:00:02.442955 23604 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:34439
I20260806 17:00:02.443288 23780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:34439 every 8 connection(s)
I20260806 17:00:02.444213 23604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:00:02.449096 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23604
I20260806 17:00:02.449610 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:34557
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:34207
--webserver_port=41999
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:00:02.460189 23665 log.cc:824] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:02.468264 23665 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:02.468806 23665 tablet_bootstrap.cc:492] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Bootstrap complete.
I20260806 17:00:02.470397 23665 ts_tablet_manager.cc:1397] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Time spent bootstrapping tablet: real 0.040s user 0.019s sys 0.016s
I20260806 17:00:02.473320 23665 raft_consensus.cc:348] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:02.474083 23665 raft_consensus.cc:729] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab3f518398d7424fb75a439a3ab26670, State: Initialized, Role: FOLLOWER
I20260806 17:00:02.474689 23665 consensus_queue.cc:260] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:02.475836 23665 ts_tablet_manager.cc:1428] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
W20260806 17:00:02.495590 23784 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:00:02.446492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:48091)
0806 17:00:02.447046 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.447105 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:02.447968 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:02.494390 (+ 46422us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":166,"threads_started":1}
W20260806 17:00:02.496347 23781 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:34207 (0 consecutive failures): Network error: Failed to ping master at 127.7.153.62:34207: Client connection negotiation failed: client connection to 127.7.153.62:34207: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 17:00:02.497313 23784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.496956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:43371)
0806 17:00:02.497122 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.497230 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 17:00:02.498129 23784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.497878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:52379)
0806 17:00:02.498002 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.498062 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 17:00:02.498391 23781 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 17:00:02.595630 23785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:02.595996 23785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:02.596077 23785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:02.600728 23785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:02.600878 23785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:02.600988 23785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:00:02.606918 23785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:34557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=41999
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:02.608217 23785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:02.609928 23785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:02.620870 23792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:02.620916 23793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:02.621109 23785 server_base.cc:1034] running on GCE node
W20260806 17:00:02.620870 23795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:02.621716 23785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:02.622507 23785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:02.623714 23785 hybrid_clock.cc:648] HybridClock initialized: now 1786035602623666 us; error 61 us; skew 500 ppm
Aug 06 17:00:02 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035602, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:02.627908 23785 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:00:02.629066 23785 webserver.cc:460] Webserver started at http://127.7.153.2:41999/ using document root <none> and password file <none>
I20260806 17:00:02.629703 23785 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:02.629773 23785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:02.634032 23785 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260806 17:00:02.636926 23802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.638437 23785 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 17:00:02.638626 23785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "19ba89fbae774f7282fac054eb579601"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "ff932b576716aea3335c6c5cfa412f84"
server_key_iv: "560be6acfb2761e1433b6e71ab32df7b"
server_key_version: "encryptionkey@0"
I20260806 17:00:02.639242 23785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:02.656059 23785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:02.660106 23785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:02.660374 23785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:02.661129 23785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:02.662114 23785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:02.662191 23785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.662268 23785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:02.662323 23785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.672495 23785 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:34557
I20260806 17:00:02.672519 23920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:34557 every 8 connection(s)
I20260806 17:00:02.673794 23785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:00:02.677980 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.676242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:42785)
0806 17:00:02.677042 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.677185 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":135,"threads_started":1}
W20260806 17:00:02.678522 23921 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:34207 (0 consecutive failures): Network error: Failed to ping master at 127.7.153.62:34207: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
I20260806 17:00:02.679286 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.678997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:32867)
0806 17:00:02.679154 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.679221 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 17:00:02.680217 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.679987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:38521)
0806 17:00:02.680118 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.680165 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 17:00:02.680570 23921 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 17:00:02.684059 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23785
I20260806 17:00:02.684509 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:35427
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:34207
--webserver_port=44143
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:42013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:02.807637 23924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:02.807957 23924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:02.808005 23924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:02.812479 23924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:02.812565 23924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:02.812631 23924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:00:02.818498 23924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:35427
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=44143
--tserver_master_addrs=127.7.153.62:34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:02.819754 23924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:02.820936 23924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:02.831845 23930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:02.831845 23929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:02.831876 23933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:02.832170 23924 server_base.cc:1034] running on GCE node
I20260806 17:00:02.832794 23924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:02.833515 23924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:02.834700 23924 hybrid_clock.cc:648] HybridClock initialized: now 1786035602834673 us; error 41 us; skew 500 ppm
Aug 06 17:00:02 dist-test-slave-cbsf krb5kdc[22385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035602, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:02.837915 23924 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:00:02.839010 23924 webserver.cc:460] Webserver started at http://127.7.153.3:44143/ using document root <none> and password file <none>
I20260806 17:00:02.839673 23924 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:02.839777 23924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:02.844496 23924 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:02.847033 23942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.848471 23924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:02.848665 23924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "da82cfb1bff74113a6aa173d435be9ff"
format_stamp: "Formatted at 2026-08-06 16:59:59 on dist-test-slave-cbsf"
server_key: "e304fcf87d4feea1a91dd3aa9dfa1551"
server_key_iv: "e3a28c8e20e7b3caf54a25bad6fc96c9"
server_key_version: "encryptionkey@0"
I20260806 17:00:02.849388 23924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:02.863679 23924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:02.867923 23924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:02.868196 23924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:02.868973 23924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:02.870021 23924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:02.870100 23924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.870170 23924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:02.870215 23924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:02.880190 23924 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:35427
I20260806 17:00:02.880226 24062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:35427 every 8 connection(s)
I20260806 17:00:02.881410 23924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:00:02.883701 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 23924
I20260806 17:00:02.886209 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.884436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:36697)
0806 17:00:02.885285 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.885416 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":173,"threads_started":1}
W20260806 17:00:02.886826 24063 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:34207 (0 consecutive failures): Network error: Failed to ping master at 127.7.153.62:34207: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
I20260806 17:00:02.887552 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.887282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:40021)
0806 17:00:02.887416 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.887480 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 17:00:02.888249 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:02.888012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:50557)
0806 17:00:02.888147 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:02.888194 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 17:00:02.888491 24063 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 17:00:03.499631 24067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:03.499123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:49851)
0806 17:00:03.499433 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:03.499501 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":89,"threads_started":1}
I20260806 17:00:03.681942 24068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:03.681390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:42311)
0806 17:00:03.681734 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:03.681801 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":117,"threads_started":1}
I20260806 17:00:03.889717 24069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:03.889249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:41231)
0806 17:00:03.889536 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:03.889600 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":82,"threads_started":1}
I20260806 17:00:04.303619 24070 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:04.303910 24070 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:04.305231 24070 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
Aug 06 17:00:04 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035602, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.3@KRBTEST.COM
Aug 06 17:00:04 dist-test-slave-cbsf krb5kdc[22385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035602, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.2@KRBTEST.COM
I20260806 17:00:04.328559 24071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.305525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:34557 (local address 127.7.153.1:47695)
0806 17:00:04.306089 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:04.306106 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:04.306238 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:04.308148 (+ 1910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:04.308154 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:04.308542 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:04.309179 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:04.309195 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.310770 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.310776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:04.311895 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:04.311907 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.312727 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.312732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:04.312964 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:04.318851 (+ 5887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:04.318864 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:04.321168 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:04.324727 (+ 3559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:04.324737 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:04.324757 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:04.325409 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:04.325916 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:04.325919 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:04.325922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:04.326167 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:04.327210 (+ 1043us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:04.327218 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:04.327645 (+ 427us) client_negotiation.cc:769] Sending connection context
0806 17:00:04.327888 (+ 243us) client_negotiation.cc:240] Negotiation successful
0806 17:00:04.328315 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":355,"spinlock_wait_cycles":69632,"thread_start_us":79,"threads_started":1}
I20260806 17:00:04.328560 24074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.305936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:35427 (local address 127.7.153.1:58797)
0806 17:00:04.306267 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:04.306286 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:04.306415 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:04.308600 (+ 2185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:04.308602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:04.308850 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:04.309178 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:04.309195 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.310787 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.310789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:04.311893 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:04.311906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.312716 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.312721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:04.313006 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:04.318832 (+ 5826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:04.318856 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:04.320912 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:04.324729 (+ 3817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:04.324737 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:04.324757 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:04.325409 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:04.325916 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:04.325919 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:04.325922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:04.326167 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:04.327210 (+ 1043us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:04.327218 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:04.327648 (+ 430us) client_negotiation.cc:769] Sending connection context
0806 17:00:04.327888 (+ 240us) client_negotiation.cc:240] Negotiation successful
0806 17:00:04.328368 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":377,"spinlock_wait_cycles":51840,"thread_start_us":87,"threads_started":1}
I20260806 17:00:04.328624 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.305689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:47695 (local address 127.7.153.2:34557)
0806 17:00:04.306077 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:04.306098 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:04.306219 (+ 121us) server_negotiation.cc:407] Connection header received
0806 17:00:04.307242 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:04.307252 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:04.307727 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:04.308081 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:04.309390 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.310581 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.312041 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.312545 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.312763 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:04.321400 (+ 8637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:04.321407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:04.321420 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:04.321460 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:04.324447 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:04.325578 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:04.325587 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:04.325593 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:04.325793 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:04.326329 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:04.326333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:04.326336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:04.327046 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:04.327216 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:04.328092 (+ 876us) server_negotiation.cc:299] Negotiation successful
0806 17:00:04.328415 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":98,"threads_started":1}
I20260806 17:00:04.328624 24075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.306189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:58797 (local address 127.7.153.3:35427)
0806 17:00:04.306553 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:04.306576 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:04.306613 (+ 37us) server_negotiation.cc:407] Connection header received
0806 17:00:04.307364 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:04.307371 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:04.307726 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:04.308081 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:04.309380 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.310584 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.312039 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:04.312544 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:04.312763 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:04.321299 (+ 8536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:04.321309 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:04.321330 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:04.321376 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:04.324447 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:04.325586 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:04.325592 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:04.325596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:04.325793 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:04.326329 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:04.326333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:04.326336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:04.327045 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:04.327215 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:04.328092 (+ 877us) server_negotiation.cc:299] Negotiation successful
0806 17:00:04.328415 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":99,"threads_started":1}
W20260806 17:00:04.331538 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
W20260806 17:00:04.332056 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
I20260806 17:00:04.332152 23662 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab3f518398d7424fb75a439a3ab26670; no voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff
I20260806 17:00:04.332458 24070 raft_consensus.cc:2726] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:00:04.501037 24071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.500575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:60173)
0806 17:00:04.500893 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:04.500951 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227}
I20260806 17:00:04.683338 24076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.682835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:38865)
0806 17:00:04.683136 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:04.683200 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":90,"threads_started":1}
I20260806 17:00:04.891549 24077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:04.890877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:59163)
0806 17:00:04.891291 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:04.891379 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":99,"threads_started":1}
I20260806 17:00:05.502624 24078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:05.501954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:44415)
0806 17:00:05.502445 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:05.502521 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":90,"threads_started":1}
I20260806 17:00:05.685189 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:05.684404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:38491)
0806 17:00:05.684957 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:05.685061 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":109,"threads_started":1}
I20260806 17:00:05.893208 24081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:05.892615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:38495)
0806 17:00:05.893003 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:05.893064 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":144,"threads_started":1}
I20260806 17:00:06.279397 24082 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:06.279609 24082 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:06.280095 24082 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
W20260806 17:00:06.281149 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
W20260806 17:00:06.281301 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
I20260806 17:00:06.281364 23662 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab3f518398d7424fb75a439a3ab26670; no voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff
I20260806 17:00:06.281571 24082 raft_consensus.cc:2726] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:00:06.504406 24083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:06.503903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:57121)
0806 17:00:06.504223 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:06.504303 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":104,"threads_started":1}
I20260806 17:00:06.686582 24084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:06.686138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:35511)
0806 17:00:06.686420 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:06.686480 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":85,"threads_started":1}
I20260806 17:00:06.894753 24085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:06.894179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:46579)
0806 17:00:06.894508 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:06.894638 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":99,"threads_started":1}
I20260806 17:00:07.506251 24086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:07.505648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:46405)
0806 17:00:07.506050 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:07.506134 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":145,"threads_started":1}
I20260806 17:00:07.687966 24087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:07.687491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:60265)
0806 17:00:07.687795 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:07.687865 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":94,"threads_started":1}
I20260806 17:00:07.896224 24088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:07.895719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:55575)
0806 17:00:07.896041 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:07.896107 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":115,"threads_started":1}
I20260806 17:00:08.507681 24089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:08.507227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:53409)
0806 17:00:08.507500 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:08.507562 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":84,"threads_started":1}
I20260806 17:00:08.689564 24090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:08.689042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:40141)
0806 17:00:08.689391 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:08.689458 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":114,"threads_started":1}
I20260806 17:00:08.897687 24091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:08.897193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:54139)
0806 17:00:08.897533 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:08.897589 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":108,"threads_started":1}
I20260806 17:00:09.401093 24092 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:09.401232 24092 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:09.401644 24092 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
W20260806 17:00:09.402483 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
W20260806 17:00:09.402626 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
I20260806 17:00:09.402686 23662 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab3f518398d7424fb75a439a3ab26670; no voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff
I20260806 17:00:09.402853 24092 raft_consensus.cc:2726] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:00:09.509234 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:09.508658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:56359)
0806 17:00:09.509061 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:09.509125 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":117,"threads_started":1}
I20260806 17:00:09.691071 24094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:09.690533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:43811)
0806 17:00:09.690889 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:09.690956 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":101,"threads_started":1}
I20260806 17:00:09.899163 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:09.898579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:45287)
0806 17:00:09.898997 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:09.899063 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":87,"threads_started":1}
I20260806 17:00:10.510895 24096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:10.510198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:46269)
0806 17:00:10.510630 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:10.510755 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":87,"threads_started":1}
I20260806 17:00:10.692824 24097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:10.692160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:40581)
0806 17:00:10.692595 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:10.692676 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":83,"threads_started":1}
I20260806 17:00:10.900619 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:10.900149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:60407)
0806 17:00:10.900418 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:10.900512 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
I20260806 17:00:11.512373 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:11.511924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:48793)
0806 17:00:11.512202 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:11.512264 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":88,"threads_started":1}
I20260806 17:00:11.694192 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:11.693726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:41321)
0806 17:00:11.694016 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:11.694085 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":89,"threads_started":1}
I20260806 17:00:11.901947 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:11.901447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:49611)
0806 17:00:11.901754 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:11.901813 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":113,"threads_started":1}
I20260806 17:00:12.108170 24103 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:12.108327 24103 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:12.108865 24103 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
W20260806 17:00:12.110095 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
W20260806 17:00:12.110457 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
I20260806 17:00:12.110551 23662 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab3f518398d7424fb75a439a3ab26670; no voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff
I20260806 17:00:12.110754 24103 raft_consensus.cc:2726] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:00:12.513707 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:12.513284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:51381)
0806 17:00:12.513540 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:12.513597 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":89,"threads_started":1}
I20260806 17:00:12.695588 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:12.695086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:47561)
0806 17:00:12.695402 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:12.695472 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":89,"threads_started":1}
I20260806 17:00:12.903566 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:12.903032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:50785)
0806 17:00:12.903373 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:12.903445 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":127,"threads_started":1}
I20260806 17:00:13.515237 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:13.514710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:34295)
0806 17:00:13.515063 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:13.515134 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":92,"threads_started":1}
I20260806 17:00:13.696954 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:13.696450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:50005)
0806 17:00:13.696785 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:13.696853 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":108,"threads_started":1}
I20260806 17:00:13.904965 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:13.904415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:49421)
0806 17:00:13.904793 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:13.904860 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":107,"threads_started":1}
I20260806 17:00:14.516825 24110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:14.516217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:45837)
0806 17:00:14.516568 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:14.516637 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":121,"threads_started":1}
I20260806 17:00:14.698364 24111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:14.697854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:48315)
0806 17:00:14.698181 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:14.698255 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":88,"threads_started":1}
I20260806 17:00:14.839411 24112 raft_consensus.cc:482] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:14.839617 24112 raft_consensus.cc:504] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19ba89fbae774f7282fac054eb579601" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 34557 } } peers { permanent_uuid: "da82cfb1bff74113a6aa173d435be9ff" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 35427 } } peers { permanent_uuid: "ab3f518398d7424fb75a439a3ab26670" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34439 } }
I20260806 17:00:14.840071 24112 leader_election.cc:288] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557), da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427)
W20260806 17:00:14.841032 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19ba89fbae774f7282fac054eb579601 (127.7.153.2:34557): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
W20260806 17:00:14.841150 23662 leader_election.cc:341] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer da82cfb1bff74113a6aa173d435be9ff (127.7.153.3:35427): Not found: Tablet not found: 946cc631d093463596cf31b161a18764
I20260806 17:00:14.841189 23662 leader_election.cc:302] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab3f518398d7424fb75a439a3ab26670; no voters: 19ba89fbae774f7282fac054eb579601, da82cfb1bff74113a6aa173d435be9ff
I20260806 17:00:14.841331 24112 raft_consensus.cc:2726] T 946cc631d093463596cf31b161a18764 P ab3f518398d7424fb75a439a3ab26670 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:00:14.906397 24113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:14.905863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:51235)
0806 17:00:14.906219 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:14.906289 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":119,"threads_started":1}
I20260806 17:00:15.518343 24114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:15.517830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:35289)
0806 17:00:15.518172 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:15.518241 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":116,"threads_started":1}
I20260806 17:00:15.700515 24115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:15.699647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:33783)
0806 17:00:15.700192 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:15.700342 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":180,"threads_started":1}
I20260806 17:00:15.907990 24116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:15.907464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:46585)
0806 17:00:15.907819 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:15.907887 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260806 17:00:16.520306 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:16.519659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:52077)
0806 17:00:16.520092 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:16.520186 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":128,"threads_started":1}
I20260806 17:00:16.702241 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:16.701660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:35121)
0806 17:00:16.701965 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:16.702066 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":93,"threads_started":1}
I20260806 17:00:16.909380 24119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:16.908943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.3:37557)
0806 17:00:16.909217 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:16.909280 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":85,"threads_started":1}
I20260806 17:00:17.521912 24120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:17.521497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.1:44037)
0806 17:00:17.521759 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:17.521818 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":111,"threads_started":1}
I20260806 17:00:17.703704 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:17.703200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34207 (local address 127.7.153.2:39633)
0806 17:00:17.703501 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:17.703588 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:34207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":98,"threads_started":1}
I20260806 17:00:17.890051 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 23604
I20260806 17:00:17.901793 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 23785
I20260806 17:00:17.910153 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 23924
2026-08-06T17:00:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20145 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:00:17 dist-test-slave-cbsf krb5kdc[24124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:00:17 dist-test-slave-cbsf krb5kdc[24124](info): set up 2 sockets
Aug 06 17:00:17 dist-test-slave-cbsf krb5kdc[24124](info): commencing operation
krb5kdc: starting...
W20260806 17:00:19.008591 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:00:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:00:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:00:19.152932 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42897
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:19.278112 24138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:19.278538 24138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:19.278640 24138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:19.284044 24138 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 17:00:19.284159 24138 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 17:00:19.284188 24138 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 17:00:19.284214 24138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:00:19.284255 24138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:19.284300 24138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:19.284353 24138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:00:19.284394 24138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:00:19.290678 24138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:19.291985 24138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:19.293439 24138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:19.303078 24144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:19.303251 24138 server_base.cc:1034] running on GCE node
W20260806 17:00:19.303078 24148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:19.303078 24145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:19.304108 24138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:19.305457 24138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:19.306692 24138 hybrid_clock.cc:648] HybridClock initialized: now 1786035619306677 us; error 32 us; skew 500 ppm
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:19.309909 24138 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:00:19.311035 24138 webserver.cc:460] Webserver started at http://127.7.153.62:44725/ using document root <none> and password file <none>
I20260806 17:00:19.311694 24138 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:19.311789 24138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:19.312039 24138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:00:19.314949 24138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "ed76d684c79b48f5933eab7e63412138"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "1d5448fb0127547f6063eff1bf7e425d"
server_key_iv: "cdd9b073c0b4242997da15993e973e20"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.315685 24138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "ed76d684c79b48f5933eab7e63412138"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "1d5448fb0127547f6063eff1bf7e425d"
server_key_iv: "cdd9b073c0b4242997da15993e973e20"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.320308 24138 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 17:00:19.323400 24155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.325069 24138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 17:00:19.325245 24138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "ed76d684c79b48f5933eab7e63412138"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "1d5448fb0127547f6063eff1bf7e425d"
server_key_iv: "cdd9b073c0b4242997da15993e973e20"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.325393 24138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:19.345997 24138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:19.350019 24138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:19.350271 24138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:19.358181 24138 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42897
I20260806 17:00:19.358525 24211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42897 every 8 connection(s)
I20260806 17:00:19.359292 24138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:00:19.361864 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24138
I20260806 17:00:19.362028 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:00:19.362372 7780 external_mini_cluster.cc:1428] Setting key 377e62d12b0d7e554a49c5db95546877
I20260806 17:00:19.362715 24212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:19.371187 24212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap starting.
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:19.374384 24212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:19.375535 24212 log.cc:824] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:19.378183 24212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: No bootstrap required, opened a new log
I20260806 17:00:19.379570 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:19.363962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38500 (local address 127.7.153.62:42897)
0806 17:00:19.364480 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:19.364498 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:19.364540 (+ 42us) server_negotiation.cc:407] Connection header received
0806 17:00:19.365386 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:19.365408 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:19.365805 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:19.366142 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:19.367208 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.368370 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.369704 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.370327 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.370497 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:19.373772 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:19.373779 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:19.373797 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:19.373838 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:19.376254 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:19.376851 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:19.376857 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:19.376863 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:19.376997 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:19.377321 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:19.377324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:19.377325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:19.377775 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:19.378003 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:19.378297 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 17:00:19.378761 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":192,"threads_started":1}
I20260806 17:00:19.381829 24212 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:19.382154 24212 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:19.382237 24212 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed76d684c79b48f5933eab7e63412138, State: Initialized, Role: FOLLOWER
I20260806 17:00:19.382772 24212 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:19.382958 24212 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:00:19.383035 24212 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:00:19.383152 24212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:19.384344 24212 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:19.384826 24212 leader_election.cc:302] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed76d684c79b48f5933eab7e63412138; no voters:
I20260806 17:00:19.385257 24212 leader_election.cc:288] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:00:19.385396 24217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:00:19.385687 24217 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 LEADER]: Becoming Leader. State: Replica: ed76d684c79b48f5933eab7e63412138, State: Running, Role: LEADER
I20260806 17:00:19.386123 24217 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:19.386746 24212 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:00:19.388056 24219 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed76d684c79b48f5933eab7e63412138. Latest consensus state: current_term: 1 leader_uuid: "ed76d684c79b48f5933eab7e63412138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } } }
I20260806 17:00:19.388218 24219 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:19.388605 24218 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed76d684c79b48f5933eab7e63412138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } } }
I20260806 17:00:19.388760 24218 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:19.389645 24227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:00:19.392560 24227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:00:19.398443 24227 catalog_manager.cc:1347] Generated new cluster ID: 7f9acf9789f5471691ffc470e0323b54
I20260806 17:00:19.398543 24227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:00:19.429332 24227 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:00:19.430680 24227 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:00:19.440079 24227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Generated new TSK 0
I20260806 17:00:19.440995 24227 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 17:00:19.484205 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42897
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:19.625991 24240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:19.626317 24240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:19.626363 24240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:19.630923 24240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:19.631028 24240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:19.631127 24240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:00:19.637265 24240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:19.638494 24240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:19.639554 24240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:19.650362 24246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:19.650539 24248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:19.650406 24240 server_base.cc:1034] running on GCE node
W20260806 17:00:19.650409 24245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:19.651217 24240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:19.651957 24240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:19.653455 24240 hybrid_clock.cc:648] HybridClock initialized: now 1786035619653385 us; error 37 us; skew 500 ppm
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:19.657773 24240 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:00:19.658946 24240 webserver.cc:460] Webserver started at http://127.7.153.1:45269/ using document root <none> and password file <none>
I20260806 17:00:19.659619 24240 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:19.659725 24240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:19.659978 24240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:00:19.662425 24240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "61c514cec792ba4ba3b774a55894d02c"
server_key_iv: "ff11cd2fa37cf5afccad768b3b1b53c3"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.663074 24240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "61c514cec792ba4ba3b774a55894d02c"
server_key_iv: "ff11cd2fa37cf5afccad768b3b1b53c3"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.667511 24240 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 17:00:19.671818 24257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.673584 24240 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:00:19.673806 24240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "61c514cec792ba4ba3b774a55894d02c"
server_key_iv: "ff11cd2fa37cf5afccad768b3b1b53c3"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.673995 24240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:19.697903 24240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:19.701762 24240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:19.701997 24240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:19.702677 24240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:19.703804 24240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:19.703895 24240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.704005 24240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:19.704051 24240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.715497 24240 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:35061
I20260806 17:00:19.715559 24376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:35061 every 8 connection(s)
I20260806 17:00:19.716894 24240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:00:19.725014 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24240
I20260806 17:00:19.725190 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:00:19.725490 7780 external_mini_cluster.cc:1428] Setting key 4bef3ee4edb89061899d5e8f72befa06
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:19.733959 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:19.719365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:37881 (local address 127.7.153.62:42897)
0806 17:00:19.719597 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:19.719603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:19.720503 (+ 900us) server_negotiation.cc:407] Connection header received
0806 17:00:19.722004 (+ 1501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:19.722007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:19.722063 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:19.722153 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:19.723692 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.724562 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.726199 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.726533 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.726675 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:19.729643 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:19.729646 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:19.729649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:19.729679 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:19.731286 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:19.731949 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:19.731952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:19.731953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:19.732047 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:19.732431 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:19.732434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:19.732436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:19.732777 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:19.732892 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:19.733596 (+ 704us) server_negotiation.cc:299] Negotiation successful
0806 17:00:19.733770 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 17:00:19.734915 24380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:19.719747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:37881)
0806 17:00:19.720320 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:19.720372 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:19.721758 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:19.722401 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:19.722409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:19.722865 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:19.723425 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:19.723440 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.724853 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.724856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:19.726016 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:19.726049 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.726725 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.726728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:19.726979 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:19.727684 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:19.727702 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:19.729418 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:19.731446 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:19.731454 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:19.731477 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:19.731797 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:19.732153 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:19.732156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:19.732158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:19.732322 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:19.732892 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:19.732902 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:19.733220 (+ 318us) client_negotiation.cc:769] Sending connection context
0806 17:00:19.733445 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 17:00:19.733941 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":149,"threads_started":1}
I20260806 17:00:19.736826 24378 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42897
I20260806 17:00:19.737305 24378 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 17:00:19.738032 24378 heartbeater.cc:511] Master 127.7.153.62:42897 requested a full tablet report, sending...
I20260806 17:00:19.740342 24173 ts_manager.cc:194] Registered new tserver with Master: 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 17:00:19.741931 24173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:37881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 17:00:19.760746 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42897
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:19.894716 24383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:19.895062 24383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:19.895113 24383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:19.900048 24383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:19.900123 24383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:19.900197 24383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:00:19.906239 24383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:19.907487 24383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:19.908669 24383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:19.920679 24389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:19.920769 24391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:19.920679 24388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:19.920902 24383 server_base.cc:1034] running on GCE node
I20260806 17:00:19.921500 24383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:19.922257 24383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:19.923457 24383 hybrid_clock.cc:648] HybridClock initialized: now 1786035619923437 us; error 32 us; skew 500 ppm
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:19.926625 24383 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:00:19.927683 24383 webserver.cc:460] Webserver started at http://127.7.153.2:38037/ using document root <none> and password file <none>
I20260806 17:00:19.928326 24383 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:19.928422 24383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:19.928673 24383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:00:19.931115 24383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "72692541b3f8481bbb60084edda93e61"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "dc1b2cd709f5064f699d751f21b8b1e5"
server_key_iv: "3b69bf452968543ce0a3beb028edeaf5"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.931770 24383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "72692541b3f8481bbb60084edda93e61"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "dc1b2cd709f5064f699d751f21b8b1e5"
server_key_iv: "3b69bf452968543ce0a3beb028edeaf5"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.936046 24383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 17:00:19.939081 24398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.940662 24383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:19.940836 24383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "72692541b3f8481bbb60084edda93e61"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "dc1b2cd709f5064f699d751f21b8b1e5"
server_key_iv: "3b69bf452968543ce0a3beb028edeaf5"
server_key_version: "encryptionkey@0"
I20260806 17:00:19.940953 24383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:19.957500 24383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:19.961205 24383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:19.961393 24383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:19.962139 24383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:19.963239 24383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:19.963299 24383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.963348 24383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:19.963364 24383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:19.972970 24383 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:46387
I20260806 17:00:19.973043 24517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:46387 every 8 connection(s)
I20260806 17:00:19.973992 24383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:00:19.980042 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24383
I20260806 17:00:19.980182 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:00:19.980480 7780 external_mini_cluster.cc:1428] Setting key f63106fd23df2c6543b75f350b929bcf
Aug 06 17:00:19 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035619, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:19.990957 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:19.976086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:40895 (local address 127.7.153.62:42897)
0806 17:00:19.976273 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:19.976277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:19.977424 (+ 1147us) server_negotiation.cc:407] Connection header received
0806 17:00:19.978541 (+ 1117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:19.978545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:19.978637 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:19.978754 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:19.980225 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.980921 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.983003 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.983469 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.983598 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:19.986862 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:19.986866 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:19.986869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:19.986903 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:19.988502 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:19.989247 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:19.989251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:19.989253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:19.989342 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:19.989728 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:19.989731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:19.989733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:19.989947 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:19.990055 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:19.990643 (+ 588us) server_negotiation.cc:299] Negotiation successful
0806 17:00:19.990785 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 17:00:19.992030 24520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:19.976439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:40895)
0806 17:00:19.977247 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:19.977296 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:19.978295 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:19.978963 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:19.978971 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:19.979414 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:19.980060 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:19.980077 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.981098 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.981101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:19.982822 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:19.982840 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:19.983724 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:19.983728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:19.983908 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:19.984650 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:19.984669 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:19.986650 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:19.988673 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:19.988682 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:19.988737 (+ 55us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:19.989135 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:19.989445 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:19.989448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:19.989450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:19.989616 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:19.990056 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:19.990073 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:19.990367 (+ 294us) client_negotiation.cc:769] Sending connection context
0806 17:00:19.990572 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 17:00:19.990949 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":144,"threads_started":1}
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 17:00:19.993534 24518 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42897
I20260806 17:00:19.993850 24518 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:19.994413 24518 heartbeater.cc:511] Master 127.7.153.62:42897 requested a full tablet report, sending...
I20260806 17:00:19.995678 24173 ts_manager.cc:194] Registered new tserver with Master: 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 17:00:19.996598 24173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:40895
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 17:00:20.015928 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42897
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:20.149559 24523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:20.149931 24523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:20.149982 24523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:20.154707 24523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:20.154793 24523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:20.154858 24523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:00:20.161257 24523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:20.162501 24523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:20.163573 24523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:20.174228 24529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:20.174265 24531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:20.174396 24523 server_base.cc:1034] running on GCE node
W20260806 17:00:20.174607 24528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:20.175141 24523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:20.175870 24523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:20.177116 24523 hybrid_clock.cc:648] HybridClock initialized: now 1786035620177066 us; error 72 us; skew 500 ppm
Aug 06 17:00:20 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035620, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:20.180644 24523 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:00:20.182312 24523 webserver.cc:460] Webserver started at http://127.7.153.3:39441/ using document root <none> and password file <none>
I20260806 17:00:20.183053 24523 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:20.183168 24523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:20.183451 24523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:00:20.186103 24523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "8f98add19a3f4cbe929e08dabdcaf8c9"
format_stamp: "Formatted at 2026-08-06 17:00:20 on dist-test-slave-cbsf"
server_key: "9fc2c032f0a0a4d16516d98eaf787ef7"
server_key_iv: "045be8423ac89552510a070390592882"
server_key_version: "encryptionkey@0"
I20260806 17:00:20.186817 24523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "8f98add19a3f4cbe929e08dabdcaf8c9"
format_stamp: "Formatted at 2026-08-06 17:00:20 on dist-test-slave-cbsf"
server_key: "9fc2c032f0a0a4d16516d98eaf787ef7"
server_key_iv: "045be8423ac89552510a070390592882"
server_key_version: "encryptionkey@0"
I20260806 17:00:20.192437 24523 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 17:00:20.195887 24540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:20.197631 24523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:20.197827 24523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "8f98add19a3f4cbe929e08dabdcaf8c9"
format_stamp: "Formatted at 2026-08-06 17:00:20 on dist-test-slave-cbsf"
server_key: "9fc2c032f0a0a4d16516d98eaf787ef7"
server_key_iv: "045be8423ac89552510a070390592882"
server_key_version: "encryptionkey@0"
I20260806 17:00:20.197988 24523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:20.219777 24523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:20.223707 24523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:20.223971 24523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:20.224783 24523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:20.225796 24523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:20.225878 24523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:20.225958 24523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:20.226007 24523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:20.238179 24523 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:46737
I20260806 17:00:20.238193 24665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:46737 every 8 connection(s)
I20260806 17:00:20.239370 24523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:00:20.245688 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24523
I20260806 17:00:20.245819 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:00:20.246186 7780 external_mini_cluster.cc:1428] Setting key b5e8ea18da8a8efb4f3cf3a4855254dd
Aug 06 17:00:20 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035620, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:20.254902 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.241657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:39685 (local address 127.7.153.62:42897)
0806 17:00:20.241814 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.241819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.243032 (+ 1213us) server_negotiation.cc:407] Connection header received
0806 17:00:20.243932 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.243935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.243990 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.244077 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:20.245560 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.246295 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.247726 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.247951 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.248071 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.250967 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:20.250970 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:20.250973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:20.251002 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:20.252628 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:20.253206 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:20.253209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:20.253210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:20.253310 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:20.253684 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:20.253687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:20.253688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:20.253929 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:20.254041 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.254604 (+ 563us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.254759 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 17:00:20.255832 24669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.242102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:39685)
0806 17:00:20.242846 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.242891 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:20.243721 (+ 830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:20.244262 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:20.244269 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:20.244766 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:20.245383 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.245400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.246444 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.246448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.247552 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.247564 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.248120 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.248124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.248360 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.249091 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:20.249109 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:20.250759 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:20.252798 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:20.252803 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:20.252819 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:20.253091 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:20.253406 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:20.253408 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:20.253409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:20.253554 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:20.254039 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:20.254045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:20.254336 (+ 291us) client_negotiation.cc:769] Sending connection context
0806 17:00:20.254514 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 17:00:20.254815 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":140,"threads_started":1}
I20260806 17:00:20.257331 24666 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42897
I20260806 17:00:20.257602 24666 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:20.258176 24666 heartbeater.cc:511] Master 127.7.153.62:42897 requested a full tablet report, sending...
I20260806 17:00:20.259603 24173 ts_manager.cc:194] Registered new tserver with Master: 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737)
I20260806 17:00:20.260403 24173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:39685
I20260806 17:00:20.260653 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:00:20.271595 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.263054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38512 (local address 127.7.153.62:42897)
0806 17:00:20.263217 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.263220 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.263457 (+ 237us) server_negotiation.cc:407] Connection header received
0806 17:00:20.263606 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.263609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.263655 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.263734 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:20.264460 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.265117 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.266087 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.266341 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.266442 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.267972 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:20.267975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:20.267978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:20.268007 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:20.269778 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:20.270224 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:20.270227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:20.270228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:20.270320 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:20.270585 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:20.270588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:20.270589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:20.270855 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:20.270970 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.271245 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.271364 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 17:00:20.275319 24173 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38512:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:00:20.278930 24173 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:00:20.295655 24682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.289508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53796 (local address 127.7.153.3:46737)
0806 17:00:20.290082 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.290099 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.290128 (+ 29us) server_negotiation.cc:407] Connection header received
0806 17:00:20.290214 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.290220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.290451 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.290632 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:20.291001 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.292258 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.294332 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.294905 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.295049 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.295219 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.295375 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.295479 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":177,"threads_started":1}
I20260806 17:00:20.295640 24679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.288750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46737 (local address 127.0.0.1:53796)
0806 17:00:20.289194 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.289243 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:20.289372 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:20.290643 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:20.290649 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:20.290673 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:20.290859 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.290867 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.292419 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.292426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.294178 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.294184 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.295056 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.295060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.295181 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.295222 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 17:00:20.295344 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 17:00:20.295488 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":142,"thread_start_us":111,"threads_started":1}
I20260806 17:00:20.295918 24678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.288779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:35061 (local address 127.0.0.1:53106)
0806 17:00:20.289564 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.289582 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:20.289674 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:20.291328 (+ 1654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:20.291331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:20.291348 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:20.291430 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.291436 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.292466 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.292469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.294171 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.294184 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.295240 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.295246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.295519 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.295600 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 17:00:20.295670 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 17:00:20.295772 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"mutex_wait_us":294,"spinlock_wait_cycles":6912,"thread_start_us":141,"threads_started":1}
I20260806 17:00:20.296231 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.289960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.7.153.2:46387)
0806 17:00:20.290342 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.290354 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.290377 (+ 23us) server_negotiation.cc:407] Connection header received
0806 17:00:20.290451 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.290456 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.290649 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.290801 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:20.291043 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.292237 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.294052 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.294923 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.295056 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.295222 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.295765 (+ 543us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.295865 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":147,"threads_started":1}
I20260806 17:00:20.296674 24680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.289229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.7.153.1:35061)
0806 17:00:20.290939 (+ 1710us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.290948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.290972 (+ 24us) server_negotiation.cc:407] Connection header received
0806 17:00:20.291054 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.291058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.291207 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.291348 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:20.291533 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.292278 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.294321 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.295101 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.296179 (+ 1078us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.296370 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.296428 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.296546 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1600,"thread_start_us":67,"threads_started":1}
I20260806 17:00:20.297004 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.289529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46387 (local address 127.0.0.1:52934)
0806 17:00:20.289793 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.289807 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:20.289894 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:20.290800 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:20.290803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:20.290822 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:20.290920 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.290926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.292673 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.292676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.293913 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.293923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.295273 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.295276 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.295517 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.295601 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 17:00:20.295671 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 17:00:20.296861 (+ 1190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":1255,"thread_start_us":108,"threads_started":1}
I20260806 17:00:20.299235 24592 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f (DEFAULT_TABLE table=test-table [id=0fc244939d5c44c4ae50f0c235663608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:20.299512 24306 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f (DEFAULT_TABLE table=test-table [id=0fc244939d5c44c4ae50f0c235663608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:20.299518 24448 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f (DEFAULT_TABLE table=test-table [id=0fc244939d5c44c4ae50f0c235663608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:20.300545 24306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7f2e9127e0497392c25cdefc543c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:20.300559 24448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7f2e9127e0497392c25cdefc543c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:20.300721 24592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7f2e9127e0497392c25cdefc543c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:20.307885 24684 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Bootstrap starting.
I20260806 17:00:20.308827 24686 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap starting.
I20260806 17:00:20.309273 24685 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Bootstrap starting.
I20260806 17:00:20.310742 24684 tablet_bootstrap.cc:654] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:20.311466 24685 tablet_bootstrap.cc:654] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:20.311614 24684 log.cc:824] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:20.312302 24685 log.cc:824] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:20.314090 24685 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: No bootstrap required, opened a new log
I20260806 17:00:20.314183 24684 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: No bootstrap required, opened a new log
I20260806 17:00:20.314323 24685 ts_tablet_manager.cc:1397] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 17:00:20.314428 24684 ts_tablet_manager.cc:1397] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 17:00:20.314498 24686 tablet_bootstrap.cc:654] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:20.315354 24686 log.cc:824] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:20.317790 24686 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: No bootstrap required, opened a new log
I20260806 17:00:20.318022 24686 ts_tablet_manager.cc:1397] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 17:00:20.317826 24685 raft_consensus.cc:348] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.318171 24685 raft_consensus.cc:374] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:20.318249 24685 raft_consensus.cc:729] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72692541b3f8481bbb60084edda93e61, State: Initialized, Role: FOLLOWER
I20260806 17:00:20.318625 24684 raft_consensus.cc:348] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.318760 24685 consensus_queue.cc:260] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.318934 24684 raft_consensus.cc:374] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:20.319024 24684 raft_consensus.cc:729] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f98add19a3f4cbe929e08dabdcaf8c9, State: Initialized, Role: FOLLOWER
I20260806 17:00:20.319527 24684 consensus_queue.cc:260] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.319888 24685 ts_tablet_manager.cc:1428] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260806 17:00:20.320366 24666 heartbeater.cc:503] Master 127.7.153.62:42897 was elected leader, sending a full tablet report...
I20260806 17:00:20.321569 24518 heartbeater.cc:503] Master 127.7.153.62:42897 was elected leader, sending a full tablet report...
I20260806 17:00:20.323031 24684 ts_tablet_manager.cc:1428] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260806 17:00:20.322829 24686 raft_consensus.cc:348] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.323127 24686 raft_consensus.cc:374] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:20.323187 24686 raft_consensus.cc:729] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3169aa4f2e1140e1a679e1aa7e40fa7d, State: Initialized, Role: FOLLOWER
I20260806 17:00:20.323717 24686 consensus_queue.cc:260] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.324468 24378 heartbeater.cc:503] Master 127.7.153.62:42897 was elected leader, sending a full tablet report...
I20260806 17:00:20.325922 24686 ts_tablet_manager.cc:1428] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
W20260806 17:00:20.468730 24379 tablet.cc:2369] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 17:00:20.475379 24519 tablet.cc:2369] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 17:00:20.490577 24668 tablet.cc:2369] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 17:00:20.633898 24696 raft_consensus.cc:482] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:20.634188 24696 raft_consensus.cc:504] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.635444 24696 leader_election.cc:288] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
I20260806 17:00:20.639770 24682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.635838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:47029 (local address 127.7.153.3:46737)
0806 17:00:20.635990 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.635995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.636312 (+ 317us) server_negotiation.cc:407] Connection header received
0806 17:00:20.636466 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.636469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.636511 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.636604 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:20.636996 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.637503 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.638669 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.639088 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.639204 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.639272 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.639540 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.639628 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 17:00:20.639773 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.635869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:54981 (local address 127.7.153.2:46387)
0806 17:00:20.636024 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.636029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.636264 (+ 235us) server_negotiation.cc:407] Connection header received
0806 17:00:20.636434 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.636438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.636499 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.636611 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:20.636963 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.637499 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.638675 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.639079 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.639216 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.639279 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.639554 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.639640 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 17:00:20.639798 24698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.635772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46737 (local address 127.7.153.1:47029)
0806 17:00:20.636182 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.636194 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:20.636331 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:20.636657 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:20.636660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:20.636725 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:20.636856 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.636862 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.637641 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.637660 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.638534 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.638544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.639225 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.639228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.639407 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.639426 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 17:00:20.639519 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 17:00:20.639646 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":136,"spinlock_wait_cycles":5376,"thread_start_us":101,"threads_started":1}
I20260806 17:00:20.639812 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.635774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46387 (local address 127.7.153.1:54981)
0806 17:00:20.636156 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.636169 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:20.636307 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:20.636618 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:20.636621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:20.636636 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:20.636839 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.636845 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.637621 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.637626 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.638537 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:20.638547 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.639243 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.639247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:20.639379 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.639400 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 17:00:20.639525 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 17:00:20.639643 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":70,"spinlock_wait_cycles":7552,"thread_start_us":148,"threads_started":1}
I20260806 17:00:20.640697 24469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f7f2e9127e0497392c25cdefc543c3f" candidate_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72692541b3f8481bbb60084edda93e61" is_pre_election: true
I20260806 17:00:20.640720 24616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f7f2e9127e0497392c25cdefc543c3f" candidate_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" is_pre_election: true
I20260806 17:00:20.641093 24469 raft_consensus.cc:2454] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3169aa4f2e1140e1a679e1aa7e40fa7d in term 0.
I20260806 17:00:20.641093 24616 raft_consensus.cc:2454] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3169aa4f2e1140e1a679e1aa7e40fa7d in term 0.
I20260806 17:00:20.641636 24258 leader_election.cc:302] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d, 72692541b3f8481bbb60084edda93e61; no voters:
I20260806 17:00:20.641920 24696 raft_consensus.cc:2781] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:00:20.642022 24696 raft_consensus.cc:482] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:00:20.642056 24696 raft_consensus.cc:3037] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:20.643191 24696 raft_consensus.cc:504] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.643592 24696 leader_election.cc:288] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 1 election: Requested vote from peers 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
I20260806 17:00:20.644129 24469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f7f2e9127e0497392c25cdefc543c3f" candidate_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72692541b3f8481bbb60084edda93e61"
I20260806 17:00:20.644129 24616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f7f2e9127e0497392c25cdefc543c3f" candidate_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9"
I20260806 17:00:20.644289 24469 raft_consensus.cc:3037] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:20.644289 24616 raft_consensus.cc:3037] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:20.645787 24469 raft_consensus.cc:2454] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3169aa4f2e1140e1a679e1aa7e40fa7d in term 1.
I20260806 17:00:20.645787 24616 raft_consensus.cc:2454] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3169aa4f2e1140e1a679e1aa7e40fa7d in term 1.
I20260806 17:00:20.646250 24259 leader_election.cc:302] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d, 8f98add19a3f4cbe929e08dabdcaf8c9; no voters:
I20260806 17:00:20.646507 24696 raft_consensus.cc:2781] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:00:20.646739 24696 raft_consensus.cc:686] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 LEADER]: Becoming Leader. State: Replica: 3169aa4f2e1140e1a679e1aa7e40fa7d, State: Running, Role: LEADER
I20260806 17:00:20.647092 24696 consensus_queue.cc:237] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:20.650671 24171 catalog_manager.cc:5495] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1). New cstate: current_term: 1 leader_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } health_report { overall_health: UNKNOWN } } }
I20260806 17:00:20.750478 24680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.746735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54310 (local address 127.7.153.1:35061)
0806 17:00:20.746887 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:20.746892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:20.746909 (+ 17us) server_negotiation.cc:407] Connection header received
0806 17:00:20.747023 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:20.747026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:20.747086 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:20.747208 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:00:20.747465 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.747986 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.748882 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:20.749106 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:20.749217 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:20.749569 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:00:20.750038 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:00:20.750183 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:20.750252 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 17:00:20.750318 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 17:00:20.757283 24469 raft_consensus.cc:1261] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Refusing update from remote peer 3169aa4f2e1140e1a679e1aa7e40fa7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:20.757495 24616 raft_consensus.cc:1261] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Refusing update from remote peer 3169aa4f2e1140e1a679e1aa7e40fa7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:20.758220 24696 consensus_queue.cc:1035] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:20.758447 24699 consensus_queue.cc:1035] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:20.769402 24703 mvcc.cc:205] Tried to move back new op lower bound from 7315601902612799488 to 7315601902173626368. Current Snapshot: MvccSnapshot[applied={T|T < 7315601902612799488}]
I20260806 17:00:20.772311 24704 mvcc.cc:205] Tried to move back new op lower bound from 7315601902612799488 to 7315601902173626368. Current Snapshot: MvccSnapshot[applied={T|T < 7315601902612799488 or (T in {7315601902612799488})}]
I20260806 17:00:20.776779 24171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38512:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:20.777017 24171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38512:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:20.780228 24171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Sending DeleteTablet for 3 replicas of tablet 9f7f2e9127e0497392c25cdefc543c3f
I20260806 17:00:20.781350 24306 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:53106
I20260806 17:00:20.781373 24592 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:53796
I20260806 17:00:20.781693 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24240
I20260806 17:00:20.781656 24448 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:52934
I20260806 17:00:20.784663 24712 tablet_replica.cc:330] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: stopping tablet replica
I20260806 17:00:20.785127 24712 raft_consensus.cc:2229] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:20.785529 24712 raft_consensus.cc:2258] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:20.787343 24712 ts_tablet_manager.cc:1905] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:20.790045 24712 ts_tablet_manager.cc:1918] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:20.790196 24712 log.cc:1196] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/9f7f2e9127e0497392c25cdefc543c3f
I20260806 17:00:20.790514 24712 ts_tablet_manager.cc:1939] T 9f7f2e9127e0497392c25cdefc543c3f P 8f98add19a3f4cbe929e08dabdcaf8c9: Deleting consensus metadata
I20260806 17:00:20.791925 24157 catalog_manager.cc:4841] TS 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737): tablet 9f7f2e9127e0497392c25cdefc543c3f (table test-table [id=0fc244939d5c44c4ae50f0c235663608]) successfully deleted
I20260806 17:00:20.792166 24714 tablet_replica.cc:330] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: stopping tablet replica
I20260806 17:00:20.792464 24714 raft_consensus.cc:2229] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:20.792873 24714 raft_consensus.cc:2258] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 17:00:20.792999 24156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:35061 (error 108)
I20260806 17:00:20.793300 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24383
I20260806 17:00:20.796378 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.795927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:35061 (local address 127.0.0.1:54314)
0806 17:00:20.796144 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.796248 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:35061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260806 17:00:20.796757 24156 catalog_manager.cc:4584] TS 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f7f2e9127e0497392c25cdefc543c3f: Network error: Client connection negotiation failed: client connection to 127.7.153.1:35061: connect: Connection refused (error 111)
I20260806 17:00:20.803328 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24523
I20260806 17:00:20.805495 24681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:20.805154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46387 (local address 127.0.0.1:55760)
0806 17:00:20.805303 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:20.805366 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.2:46387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 17:00:20.813119 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24138
I20260806 17:00:40.823498 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42897
--webserver_interface=127.7.153.62
--webserver_port=44725
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:00:40.946480 24716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:40.946791 24716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:40.946836 24716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:40.951110 24716 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 17:00:40.951186 24716 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 17:00:40.951202 24716 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 17:00:40.951216 24716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:00:40.951236 24716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:40.951314 24716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:40.951336 24716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:00:40.951362 24716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:00:40.957108 24716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=44725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:40.958406 24716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:40.959546 24716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:40.975638 24723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:40.975651 24724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:40.975656 24726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:40.975714 24716 server_base.cc:1034] running on GCE node
I20260806 17:00:40.976789 24716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:40.978260 24716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:40.979498 24716 hybrid_clock.cc:648] HybridClock initialized: now 1786035640979475 us; error 33 us; skew 500 ppm
Aug 06 17:00:40 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035640, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:40.982815 24716 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:00:40.983968 24716 webserver.cc:460] Webserver started at http://127.7.153.62:44725/ using document root <none> and password file <none>
I20260806 17:00:40.984632 24716 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:40.984786 24716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:40.989475 24716 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:40.992393 24733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:40.994411 24716 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 17:00:40.994616 24716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "ed76d684c79b48f5933eab7e63412138"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "1d5448fb0127547f6063eff1bf7e425d"
server_key_iv: "cdd9b073c0b4242997da15993e973e20"
server_key_version: "encryptionkey@0"
I20260806 17:00:40.995663 24716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:41.013986 24716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:41.018034 24716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:41.018278 24716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:41.026312 24716 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42897
I20260806 17:00:41.026643 24789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42897 every 8 connection(s)
I20260806 17:00:41.027650 24716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:00:41.032747 24791 sys_catalog.cc:263] Verifying existing consensus state
I20260806 17:00:41.033205 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24716
I20260806 17:00:41.033728 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:35061
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:42897
--webserver_port=45269
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:00:41.035458 24791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap starting.
I20260806 17:00:41.054415 24791 log.cc:824] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:41.064147 24791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:41.064637 24791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap complete.
I20260806 17:00:41.069157 24791 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:41.069653 24791 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed76d684c79b48f5933eab7e63412138, State: Initialized, Role: FOLLOWER
I20260806 17:00:41.070246 24791 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:41.070400 24791 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:00:41.070503 24791 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:00:41.070632 24791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 1 FOLLOWER]: Advancing to term 2
I20260806 17:00:41.072853 24791 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:41.073243 24791 leader_election.cc:302] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed76d684c79b48f5933eab7e63412138; no voters:
I20260806 17:00:41.073627 24791 leader_election.cc:288] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 17:00:41.073717 24795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 17:00:41.073932 24795 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 LEADER]: Becoming Leader. State: Replica: ed76d684c79b48f5933eab7e63412138, State: Running, Role: LEADER
I20260806 17:00:41.074329 24795 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:00:41.075012 24791 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:00:41.075832 24797 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed76d684c79b48f5933eab7e63412138. Latest consensus state: current_term: 2 leader_uuid: "ed76d684c79b48f5933eab7e63412138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } } }
I20260806 17:00:41.075978 24797 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:41.076268 24796 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ed76d684c79b48f5933eab7e63412138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } } }
I20260806 17:00:41.076370 24796 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: This master's current role is: LEADER
I20260806 17:00:41.076411 24803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:00:41.081866 24803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:00:41.082903 24803 catalog_manager.cc:1259] Loaded cluster ID: 7f9acf9789f5471691ffc470e0323b54
I20260806 17:00:41.082978 24803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:00:41.085692 24803 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:00:41.086513 24803 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Loaded TSK: 0
I20260806 17:00:41.108398 24803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Generated new TSK 1
I20260806 17:00:41.108770 24803 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 17:00:41.165091 24793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:41.165468 24793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:41.165556 24793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:41.170034 24793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:41.170183 24793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:41.170291 24793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:00:41.176311 24793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:35061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=45269
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:41.177609 24793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:41.178686 24793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:41.189038 24820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:41.189057 24819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:41.189242 24793 server_base.cc:1034] running on GCE node
W20260806 17:00:41.189363 24822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:41.189839 24793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:41.190600 24793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:41.191808 24793 hybrid_clock.cc:648] HybridClock initialized: now 1786035641191783 us; error 47 us; skew 500 ppm
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035641, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:41.194753 24793 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:00:41.195858 24793 webserver.cc:460] Webserver started at http://127.7.153.1:45269/ using document root <none> and password file <none>
I20260806 17:00:41.196451 24793 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:41.196529 24793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:41.200913 24793 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:41.203534 24830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:41.205049 24793 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:41.205209 24793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "61c514cec792ba4ba3b774a55894d02c"
server_key_iv: "ff11cd2fa37cf5afccad768b3b1b53c3"
server_key_version: "encryptionkey@0"
I20260806 17:00:41.205823 24793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:41.242933 24793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:41.247045 24793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:41.247274 24793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:41.248025 24793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:41.249464 24837 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 17:00:41.253921 24793 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 17:00:41.254005 24793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260806 17:00:41.254066 24793 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 17:00:41.255896 24793 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 17:00:41.255950 24793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 17:00:41.256326 24837 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap starting.
I20260806 17:00:41.266564 24793 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:35061
I20260806 17:00:41.266677 24952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:35061 every 8 connection(s)
I20260806 17:00:41.267663 24793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:00:41.273047 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24793
I20260806 17:00:41.273599 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:46387
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:42897
--webserver_port=38037
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:00:41.278249 24837 log.cc:824] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Log is configured to *not* fsync() on all Append() calls
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035641, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:41.288401 24837 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:41.289052 24837 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap complete.
I20260806 17:00:41.290673 24837 ts_tablet_manager.cc:1397] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent bootstrapping tablet: real 0.035s user 0.028s sys 0.004s
I20260806 17:00:41.292570 24957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.270684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:49475 (local address 127.7.153.62:42897)
0806 17:00:41.271152 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.271166 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.271204 (+ 38us) server_negotiation.cc:407] Connection header received
0806 17:00:41.272394 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.272404 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.272801 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.273192 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:41.275058 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.276479 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.277849 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.278331 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.278551 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.281980 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:41.281990 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:41.282020 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:41.282073 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:41.284763 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.285679 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.285689 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.285697 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.285917 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.289289 (+ 3372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.289295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.289297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.289991 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:41.290151 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.291151 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.291562 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":116,"threads_started":1}
I20260806 17:00:41.294556 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.270070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:49475)
0806 17:00:41.270733 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.270811 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.271947 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.273277 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.273286 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.273941 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:41.274602 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.274824 (+ 222us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.276669 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.276674 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.277697 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.277708 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.278528 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.278532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.278725 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.279498 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:41.279529 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:41.281668 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:41.284973 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.284984 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.285002 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.285486 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.286089 (+ 603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.286095 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.286101 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.289079 (+ 2978us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.290279 (+ 1200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:41.290290 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:41.290715 (+ 425us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.293159 (+ 2444us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.293559 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":141,"threads_started":1}
I20260806 17:00:41.294629 24837 raft_consensus.cc:348] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.295357 24837 raft_consensus.cc:729] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3169aa4f2e1140e1a679e1aa7e40fa7d, State: Initialized, Role: FOLLOWER
I20260806 17:00:41.295897 24837 consensus_queue.cc:260] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.297196 24837 ts_tablet_manager.cc:1428] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 17:00:41.297997 24953 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42897
I20260806 17:00:41.298287 24953 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:41.299037 24953 heartbeater.cc:511] Master 127.7.153.62:42897 requested a full tablet report, sending...
I20260806 17:00:41.302055 24750 ts_manager.cc:194] Registered new tserver with Master: 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061)
I20260806 17:00:41.306272 24750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:49475
I20260806 17:00:41.309733 24953 heartbeater.cc:503] Master 127.7.153.62:42897 was elected leader, sending a full tablet report...
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035640, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.1@KRBTEST.COM
I20260806 17:00:41.317173 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.305240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:35061 (local address 127.0.0.1:60004)
0806 17:00:41.305757 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.305813 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.305983 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.306817 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.306823 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.307304 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:41.307441 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.307449 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.308495 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.308509 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.309294 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.309306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.310175 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.310179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.310309 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.310983 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:41.310995 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:41.312629 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:41.315003 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.315017 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.315024 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.315307 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.315679 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.315683 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.315685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.315785 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.316346 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:41.316353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:41.316503 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.316673 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.316958 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":150,"threads_started":1}
I20260806 17:00:41.317222 24962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.305366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.7.153.1:35061)
0806 17:00:41.306115 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.306128 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.306154 (+ 26us) server_negotiation.cc:407] Connection header received
0806 17:00:41.306243 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.306248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.306465 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.306633 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:41.307622 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.308363 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.309443 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.310040 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.310164 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.312851 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:41.312861 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:41.312882 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:41.312908 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:41.314844 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.315446 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.315453 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.315455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.315564 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.315904 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.315907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.315909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.316216 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:41.316376 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.316847 (+ 471us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.317039 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":117,"threads_started":1}
I20260806 17:00:41.318395 24885 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:60004
I20260806 17:00:41.319454 24963 tablet_replica.cc:330] stopping tablet replica
I20260806 17:00:41.319900 24963 raft_consensus.cc:2229] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:41.320226 24963 raft_consensus.cc:2258] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:41.321686 24963 ts_tablet_manager.cc:1905] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:41.327332 24963 ts_tablet_manager.cc:1918] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:41.327497 24963 log.cc:1196] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal/wals/9f7f2e9127e0497392c25cdefc543c3f
I20260806 17:00:41.327828 24963 ts_tablet_manager.cc:1939] T 9f7f2e9127e0497392c25cdefc543c3f P 3169aa4f2e1140e1a679e1aa7e40fa7d: Deleting consensus metadata
I20260806 17:00:41.330327 24734 catalog_manager.cc:4841] TS 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061): tablet 9f7f2e9127e0497392c25cdefc543c3f (table test-table [id=0fc244939d5c44c4ae50f0c235663608]) successfully deleted
W20260806 17:00:41.413614 24958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:41.413956 24958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:41.414006 24958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:41.418361 24958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:41.418459 24958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:41.418567 24958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:00:41.424393 24958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:46387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=38037
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:41.425745 24958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:41.426934 24958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:41.437718 24968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:41.437924 24958 server_base.cc:1034] running on GCE node
W20260806 17:00:41.437731 24972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:41.437742 24969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:41.438606 24958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:41.439429 24958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:41.440667 24958 hybrid_clock.cc:648] HybridClock initialized: now 1786035641440652 us; error 43 us; skew 500 ppm
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035641, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:41.443890 24958 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:00:41.445120 24958 webserver.cc:460] Webserver started at http://127.7.153.2:38037/ using document root <none> and password file <none>
I20260806 17:00:41.445844 24958 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:41.445942 24958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:41.450757 24958 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.001s
I20260806 17:00:41.453533 24980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:41.455084 24958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:41.455281 24958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "72692541b3f8481bbb60084edda93e61"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "dc1b2cd709f5064f699d751f21b8b1e5"
server_key_iv: "3b69bf452968543ce0a3beb028edeaf5"
server_key_version: "encryptionkey@0"
I20260806 17:00:41.455950 24958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:41.478186 24958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:41.482254 24958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:41.482518 24958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:41.483217 24958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:41.484534 24987 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 17:00:41.489410 24958 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 17:00:41.489550 24958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 17:00:41.489663 24958 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 17:00:41.491618 24958 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 17:00:41.491714 24958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 17:00:41.492079 24987 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Bootstrap starting.
I20260806 17:00:41.503809 24958 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:46387
I20260806 17:00:41.503866 25102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:46387 every 8 connection(s)
I20260806 17:00:41.505101 24958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:00:41.507674 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 24958
I20260806 17:00:41.508252 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:46737
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:42897
--webserver_port=39441
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:00:41.514135 24987 log.cc:824] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Log is configured to *not* fsync() on all Append() calls
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035641, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:41.522171 24957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.507727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:34241 (local address 127.7.153.62:42897)
0806 17:00:41.507967 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.507974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.509006 (+ 1032us) server_negotiation.cc:407] Connection header received
0806 17:00:41.510477 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.510485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.510589 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.510666 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:41.512673 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.513320 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.515097 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.515405 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.515555 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.518277 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:41.518281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:41.518283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:41.518313 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:41.519855 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.520415 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.520419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.520422 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.520506 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.520943 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.520947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.520949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.521162 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:41.521275 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.521821 (+ 546us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.521975 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260806 17:00:41.523078 25105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.507884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:34241)
0806 17:00:41.508790 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.508859 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.510176 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.511171 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.511182 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.511760 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:41.512456 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.512479 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.513478 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.513481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.514917 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.514932 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.515574 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.515579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.515795 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.516459 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:41.516477 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:41.518072 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:41.519994 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.520000 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.520016 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.520295 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.520615 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.520618 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.520620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.520841 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.521273 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:41.521280 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:41.521570 (+ 290us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.521762 (+ 192us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.522114 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":190,"threads_started":1}
I20260806 17:00:41.524292 25103 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42897
I20260806 17:00:41.524541 25103 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:41.524935 24987 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:00:41.525187 25103 heartbeater.cc:511] Master 127.7.153.62:42897 requested a full tablet report, sending...
I20260806 17:00:41.525409 24987 tablet_bootstrap.cc:492] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Bootstrap complete.
I20260806 17:00:41.526948 24987 ts_tablet_manager.cc:1397] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Time spent bootstrapping tablet: real 0.035s user 0.025s sys 0.007s
I20260806 17:00:41.527137 24750 ts_manager.cc:194] Registered new tserver with Master: 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
I20260806 17:00:41.528425 24750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:34241
I20260806 17:00:41.530196 24987 raft_consensus.cc:348] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.530792 24987 raft_consensus.cc:729] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72692541b3f8481bbb60084edda93e61, State: Initialized, Role: FOLLOWER
I20260806 17:00:41.531329 24987 consensus_queue.cc:260] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.532521 24987 ts_tablet_manager.cc:1428] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 17:00:41.533416 25103 heartbeater.cc:503] Master 127.7.153.62:42897 was elected leader, sending a full tablet report...
I20260806 17:00:41.534777 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.528064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46387 (local address 127.0.0.1:40816)
0806 17:00:41.528211 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.528230 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.528328 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.530186 (+ 1858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.530189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.530212 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:41.530317 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.530324 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.531659 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.531664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.532739 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.532758 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.534035 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.534042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.534313 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.534385 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.534519 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.534628 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 17:00:41.534813 25109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.528400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40816 (local address 127.7.153.2:46387)
0806 17:00:41.529306 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.529318 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.529341 (+ 23us) server_negotiation.cc:407] Connection header received
0806 17:00:41.529414 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.529420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.529973 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.530475 (+ 502us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:41.530581 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.531483 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.532909 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.533758 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.533887 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.534060 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.534561 (+ 501us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.534687 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":159,"threads_started":1}
I20260806 17:00:41.536284 25035 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7f2e9127e0497392c25cdefc543c3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40816
I20260806 17:00:41.537429 25111 tablet_replica.cc:330] stopping tablet replica
I20260806 17:00:41.537865 25111 raft_consensus.cc:2229] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:41.538160 25111 raft_consensus.cc:2258] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:41.539242 25111 ts_tablet_manager.cc:1905] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:41.543306 25111 ts_tablet_manager.cc:1918] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:41.543465 25111 log.cc:1196] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/9f7f2e9127e0497392c25cdefc543c3f
I20260806 17:00:41.543766 25111 ts_tablet_manager.cc:1939] T 9f7f2e9127e0497392c25cdefc543c3f P 72692541b3f8481bbb60084edda93e61: Deleting consensus metadata
I20260806 17:00:41.545761 24734 catalog_manager.cc:4841] TS 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387): tablet 9f7f2e9127e0497392c25cdefc543c3f (table test-table [id=0fc244939d5c44c4ae50f0c235663608]) successfully deleted
W20260806 17:00:41.641098 25106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:00:41.641431 25106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:00:41.641535 25106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:00:41.645902 25106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:00:41.645987 25106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:00:41.646085 25106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:00:41.651955 25106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:46737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=39441
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:00:41.653244 25106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:00:41.654367 25106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:00:41.665119 25120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:41.665109 25116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:00:41.665109 25117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:00:41.665469 25106 server_base.cc:1034] running on GCE node
I20260806 17:00:41.665989 25106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:00:41.666772 25106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:00:41.667984 25106 hybrid_clock.cc:648] HybridClock initialized: now 1786035641667964 us; error 34 us; skew 500 ppm
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035641, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:00:41.671165 25106 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:00:41.672151 25106 webserver.cc:460] Webserver started at http://127.7.153.3:39441/ using document root <none> and password file <none>
I20260806 17:00:41.672994 25106 fs_manager.cc:359] Metadata directory not provided
I20260806 17:00:41.673103 25106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:00:41.677770 25106 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 17:00:41.680045 25127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:41.681550 25106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:00:41.681686 25106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "8f98add19a3f4cbe929e08dabdcaf8c9"
format_stamp: "Formatted at 2026-08-06 17:00:20 on dist-test-slave-cbsf"
server_key: "9fc2c032f0a0a4d16516d98eaf787ef7"
server_key_iv: "045be8423ac89552510a070390592882"
server_key_version: "encryptionkey@0"
I20260806 17:00:41.682291 25106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:00:41.712496 25106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:00:41.716245 25106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:00:41.716427 25106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:00:41.717114 25106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:00:41.718000 25106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:00:41.718050 25106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:41.718091 25106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:00:41.718108 25106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:00:41.727577 25106 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:46737
I20260806 17:00:41.727596 25251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:46737 every 8 connection(s)
I20260806 17:00:41.728991 25106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:00:41.739037 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 25106
Aug 06 17:00:41 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035641, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:00:41.743991 24957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.731325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:56331 (local address 127.7.153.62:42897)
0806 17:00:41.731549 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.731556 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.732458 (+ 902us) server_negotiation.cc:407] Connection header received
0806 17:00:41.733441 (+ 983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.733444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.733496 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.733579 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:41.734822 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.735390 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.736613 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.736923 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.737021 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.740024 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:41.740029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:41.740032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:41.740076 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:41.741777 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.742339 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.742343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.742344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.742434 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.742804 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.742807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.742809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.743002 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:41.743125 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.743700 (+ 575us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.743824 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 17:00:41.745078 25254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.731483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:56331)
0806 17:00:41.732281 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.732336 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.733207 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.733764 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.733771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.734154 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:00:41.734663 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.734677 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.735518 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.735520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.736461 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.736471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.737107 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.737111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.737289 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.737876 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:00:41.737894 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:00:41.739789 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:00:41.741906 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.741912 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.741933 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.742225 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.742530 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:00:41.742533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:00:41.742536 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:00:41.742703 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:00:41.743125 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:00:41.743134 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:00:41.743423 (+ 289us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.743659 (+ 236us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.744033 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":145,"threads_started":1}
I20260806 17:00:41.746335 25252 heartbeater.cc:347] Connected to a master server at 127.7.153.62:42897
I20260806 17:00:41.746608 25252 heartbeater.cc:464] Registering TS with master...
I20260806 17:00:41.747264 25252 heartbeater.cc:511] Master 127.7.153.62:42897 requested a full tablet report, sending...
I20260806 17:00:41.748380 25257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.739794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.7.153.62:42897)
0806 17:00:41.740101 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.740105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.740204 (+ 99us) server_negotiation.cc:407] Connection header received
0806 17:00:41.740371 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.740376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.740430 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.740523 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:41.741570 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.742109 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.742984 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.743226 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.743335 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.744891 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:41.744897 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:41.744904 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:41.744928 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:41.746605 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.747118 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.747121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.747122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.747198 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.747474 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.747476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.747477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.747655 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:41.747854 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.748086 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.748223 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":111,"threads_started":1}
I20260806 17:00:41.748472 24750 ts_manager.cc:194] Registered new tserver with Master: 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737)
I20260806 17:00:41.749213 24750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:56331
I20260806 17:00:41.750248 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:00:41.754155 25257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.750894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50778 (local address 127.7.153.62:42897)
0806 17:00:41.751036 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.751040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.751217 (+ 177us) server_negotiation.cc:407] Connection header received
0806 17:00:41.751336 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.751339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.751456 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.751570 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:00:41.751751 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.752242 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.753126 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.753347 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.753426 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.753701 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:00:41.753835 (+ 134us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 17:00:41.754043 (+ 208us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50778: token expired
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 17:00:41.754212 25257 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50778: token expired
W20260806 17:00:41.754657 24671 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.153.62:42897)
I20260806 17:00:41.762348 25257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.755015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.7.153.62:42897)
0806 17:00:41.755148 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.755152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.755167 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:00:41.755262 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.755268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.755317 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.755382 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:00:41.755988 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.756601 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.757652 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.757868 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.757949 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.759232 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:00:41.759235 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:00:41.759237 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:00:41.759260 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:00:41.760872 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.761332 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.761334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.761336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.761410 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:00:41.761602 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:00:41.761604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:00:41.761605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:00:41.761781 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:00:41.761873 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.762108 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.762225 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 17:00:41.765129 24749 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:00:41.768455 24749 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:00:41.776799 24885 tablet_service.cc:1467] Processing CreateTablet for tablet 3b708aeeb81742e8b3c53a5798afc4e4 (DEFAULT_TABLE table=test-table [id=681a14ad1b7a4f6585d7afd22c7d937d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:41.776799 25035 tablet_service.cc:1467] Processing CreateTablet for tablet 3b708aeeb81742e8b3c53a5798afc4e4 (DEFAULT_TABLE table=test-table [id=681a14ad1b7a4f6585d7afd22c7d937d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:41.777524 25035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b708aeeb81742e8b3c53a5798afc4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:41.777524 24885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b708aeeb81742e8b3c53a5798afc4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:41.780587 24837 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap starting.
I20260806 17:00:41.780771 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.775764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46737 (local address 127.0.0.1:47532)
0806 17:00:41.775957 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.775976 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.776066 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.777020 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.777024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.777060 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:41.777214 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.777223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.778361 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.778364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.779128 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.779138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.780270 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.780274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.780375 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.780401 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.780483 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.780579 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260806 17:00:41.781292 24987 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Bootstrap starting.
I20260806 17:00:41.781432 25262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.776091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47532 (local address 127.7.153.3:46737)
0806 17:00:41.776511 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.776522 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.776543 (+ 21us) server_negotiation.cc:407] Connection header received
0806 17:00:41.776624 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.776628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.776872 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.777052 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:41.777338 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.778229 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.779261 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.780132 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.780956 (+ 824us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.781134 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.781194 (+ 60us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.781294 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":143,"threads_started":1}
I20260806 17:00:41.781617 24837 tablet_bootstrap.cc:654] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:41.782109 24987 tablet_bootstrap.cc:654] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:41.783274 24987 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: No bootstrap required, opened a new log
I20260806 17:00:41.783382 24987 ts_tablet_manager.cc:1397] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 17:00:41.783501 24837 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: No bootstrap required, opened a new log
I20260806 17:00:41.783598 24837 ts_tablet_manager.cc:1397] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 17:00:41.784062 24987 raft_consensus.cc:348] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.784045 24837 raft_consensus.cc:348] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.784191 24837 raft_consensus.cc:374] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:41.784191 24987 raft_consensus.cc:374] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:41.784243 24987 raft_consensus.cc:729] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72692541b3f8481bbb60084edda93e61, State: Initialized, Role: FOLLOWER
I20260806 17:00:41.784243 24837 raft_consensus.cc:729] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3169aa4f2e1140e1a679e1aa7e40fa7d, State: Initialized, Role: FOLLOWER
I20260806 17:00:41.784371 24987 consensus_queue.cc:260] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.784564 24837 consensus_queue.cc:260] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.784663 24987 ts_tablet_manager.cc:1428] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 17:00:41.784873 24837 ts_tablet_manager.cc:1428] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 17:00:41.785028 25183 tablet_service.cc:1467] Processing CreateTablet for tablet 3b708aeeb81742e8b3c53a5798afc4e4 (DEFAULT_TABLE table=test-table [id=681a14ad1b7a4f6585d7afd22c7d937d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:00:41.786444 25183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b708aeeb81742e8b3c53a5798afc4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:00:41.794155 25265 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Bootstrap starting.
I20260806 17:00:41.796469 25265 tablet_bootstrap.cc:654] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Neither blocks nor log segments found. Creating new log.
I20260806 17:00:41.797804 25265 log.cc:824] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Log is configured to *not* fsync() on all Append() calls
I20260806 17:00:41.799901 25265 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: No bootstrap required, opened a new log
I20260806 17:00:41.800184 25265 ts_tablet_manager.cc:1397] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 17:00:41.803612 25265 raft_consensus.cc:348] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.803917 25265 raft_consensus.cc:374] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:00:41.804001 25265 raft_consensus.cc:729] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f98add19a3f4cbe929e08dabdcaf8c9, State: Initialized, Role: FOLLOWER
I20260806 17:00:41.804512 25265 consensus_queue.cc:260] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.805305 25252 heartbeater.cc:503] Master 127.7.153.62:42897 was elected leader, sending a full tablet report...
I20260806 17:00:41.805677 25265 ts_tablet_manager.cc:1428] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 17:00:41.812892 25268 raft_consensus.cc:482] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:00:41.813148 25268 raft_consensus.cc:504] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.814321 25268 leader_election.cc:288] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
I20260806 17:00:41.819847 25254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.814625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:35061 (local address 127.7.153.3:56233)
0806 17:00:41.814839 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.814854 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.814979 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.815523 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.815526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.815556 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:41.815697 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.815708 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.816826 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.816829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.818334 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.818347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.819315 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.819318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.819458 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.819495 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.819581 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.819665 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":113}
I20260806 17:00:41.819828 24962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.814846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:56233 (local address 127.7.153.1:35061)
0806 17:00:41.815006 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.815013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.815030 (+ 17us) server_negotiation.cc:407] Connection header received
0806 17:00:41.815097 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.815099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.815366 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.815503 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:41.815834 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.816657 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.818522 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.819184 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.819313 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.819502 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.819598 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.819679 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 17:00:41.819856 25109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.815378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:60569 (local address 127.7.153.2:46387)
0806 17:00:41.815546 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.815550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.815782 (+ 232us) server_negotiation.cc:407] Connection header received
0806 17:00:41.815849 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.815851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.815902 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.815983 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:00:41.816203 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.816925 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.818480 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.819048 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.819315 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.819395 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.819640 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.819720 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 17:00:41.819885 25269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.815096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46387 (local address 127.7.153.3:60569)
0806 17:00:41.815651 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.815669 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 17:00:41.815774 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:00:41.815996 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:00:41.815999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:00:41.816013 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:00:41.816097 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.816101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.817020 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.817023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.818334 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:00:41.818347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.819314 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.819318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:00:41.819497 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.819517 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 17:00:41.819626 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 17:00:41.819705 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":92,"thread_start_us":179,"threads_started":1}
I20260806 17:00:41.820482 25055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b708aeeb81742e8b3c53a5798afc4e4" candidate_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72692541b3f8481bbb60084edda93e61" is_pre_election: true
I20260806 17:00:41.820524 24906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b708aeeb81742e8b3c53a5798afc4e4" candidate_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" is_pre_election: true
I20260806 17:00:41.820874 24906 raft_consensus.cc:2454] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f98add19a3f4cbe929e08dabdcaf8c9 in term 0.
I20260806 17:00:41.820889 25055 raft_consensus.cc:2454] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f98add19a3f4cbe929e08dabdcaf8c9 in term 0.
I20260806 17:00:41.821417 25128 leader_election.cc:302] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72692541b3f8481bbb60084edda93e61, 8f98add19a3f4cbe929e08dabdcaf8c9; no voters:
I20260806 17:00:41.821768 25268 raft_consensus.cc:2781] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:00:41.821898 25268 raft_consensus.cc:482] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:00:41.821991 25268 raft_consensus.cc:3037] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:41.823215 25268 raft_consensus.cc:504] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.823606 25268 leader_election.cc:288] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [CANDIDATE]: Term 1 election: Requested vote from peers 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
I20260806 17:00:41.824158 25055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b708aeeb81742e8b3c53a5798afc4e4" candidate_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72692541b3f8481bbb60084edda93e61"
I20260806 17:00:41.824163 24906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b708aeeb81742e8b3c53a5798afc4e4" candidate_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d"
I20260806 17:00:41.824316 24906 raft_consensus.cc:3037] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:41.824280 25055 raft_consensus.cc:3037] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:00:41.825497 24906 raft_consensus.cc:2454] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f98add19a3f4cbe929e08dabdcaf8c9 in term 1.
I20260806 17:00:41.825512 25055 raft_consensus.cc:2454] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f98add19a3f4cbe929e08dabdcaf8c9 in term 1.
I20260806 17:00:41.825911 25128 leader_election.cc:302] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d, 8f98add19a3f4cbe929e08dabdcaf8c9; no voters:
I20260806 17:00:41.826143 25268 raft_consensus.cc:2781] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:00:41.826422 25268 raft_consensus.cc:686] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 LEADER]: Becoming Leader. State: Replica: 8f98add19a3f4cbe929e08dabdcaf8c9, State: Running, Role: LEADER
I20260806 17:00:41.826815 25268 consensus_queue.cc:237] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:00:41.830385 24750 catalog_manager.cc:5495] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } health_report { overall_health: UNKNOWN } } }
I20260806 17:00:41.851411 25262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.847724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.7.153.3:46737)
0806 17:00:41.847858 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 17:00:41.847862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:00:41.847877 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:00:41.847962 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:00:41.847964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:00:41.848021 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:00:41.848168 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:00:41.848431 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.849034 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.849870 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:00:41.850091 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:00:41.850211 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:00:41.850536 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:00:41.850987 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:00:41.851136 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 17:00:41.851174 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 17:00:41.851235 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 17:00:41.858045 25055 raft_consensus.cc:1261] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Refusing update from remote peer 8f98add19a3f4cbe929e08dabdcaf8c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:41.858045 24906 raft_consensus.cc:1261] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Refusing update from remote peer 8f98add19a3f4cbe929e08dabdcaf8c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:00:41.858839 25268 consensus_queue.cc:1035] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:41.859062 25270 consensus_queue.cc:1035] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:00:41.865115 25273 mvcc.cc:205] Tried to move back new op lower bound from 7315601989042143232 to 7315601988925693952. Current Snapshot: MvccSnapshot[applied={T|T < 7315601989042143232}]
I20260806 17:00:41.875253 24750 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:41.875433 24750 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:00:41.878582 24750 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Sending DeleteTablet for 3 replicas of tablet 3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:00:41.879509 25183 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b708aeeb81742e8b3c53a5798afc4e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:41 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:47532
I20260806 17:00:41.879647 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24793
I20260806 17:00:41.879765 24885 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b708aeeb81742e8b3c53a5798afc4e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:41 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:60004
I20260806 17:00:41.880219 25035 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b708aeeb81742e8b3c53a5798afc4e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:00:41 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:40816
I20260806 17:00:41.880901 25111 tablet_replica.cc:330] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: stopping tablet replica
I20260806 17:00:41.881060 25111 raft_consensus.cc:2229] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:00:41.881228 25111 raft_consensus.cc:2258] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:41.882895 25111 ts_tablet_manager.cc:1905] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:00:41.884994 25285 tablet_replica.cc:330] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: stopping tablet replica
I20260806 17:00:41.885568 25285 raft_consensus.cc:2229] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:00:41.885749 25111 ts_tablet_manager.cc:1918] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:41.885849 25111 log.cc:1196] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:00:41.886114 25111 ts_tablet_manager.cc:1939] T 3b708aeeb81742e8b3c53a5798afc4e4 P 72692541b3f8481bbb60084edda93e61: Deleting consensus metadata
I20260806 17:00:41.886430 25285 raft_consensus.cc:2258] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:00:41.887259 24734 catalog_manager.cc:4841] TS 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387): tablet 3b708aeeb81742e8b3c53a5798afc4e4 (table test-table [id=681a14ad1b7a4f6585d7afd22c7d937d]) successfully deleted
I20260806 17:00:41.888546 25285 ts_tablet_manager.cc:1905] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 17:00:41.889426 24734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:35061 (error 108)
I20260806 17:00:41.889936 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24958
I20260806 17:00:41.892158 25285 ts_tablet_manager.cc:1918] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:00:41.892285 25285 log.cc:1196] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:00:41.892714 25285 ts_tablet_manager.cc:1939] T 3b708aeeb81742e8b3c53a5798afc4e4 P 8f98add19a3f4cbe929e08dabdcaf8c9: Deleting consensus metadata
I20260806 17:00:41.894264 24735 catalog_manager.cc:4841] TS 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737): tablet 3b708aeeb81742e8b3c53a5798afc4e4 (table test-table [id=681a14ad1b7a4f6585d7afd22c7d937d]) successfully deleted
I20260806 17:00:41.898237 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:00:41.897819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:35061 (local address 127.0.0.1:60008)
0806 17:00:41.898004 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 17:00:41.898116 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:35061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 17:00:41.898557 24734 catalog_manager.cc:4584] TS 3169aa4f2e1140e1a679e1aa7e40fa7d (127.7.153.1:35061): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b708aeeb81742e8b3c53a5798afc4e4: Network error: Client connection negotiation failed: client connection to 127.7.153.1:35061: connect: Connection refused (error 111)
I20260806 17:00:41.900079 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 25106
I20260806 17:00:41.908808 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 24716
I20260806 17:01:01.918432 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42897
--webserver_interface=127.7.153.62
--webserver_port=44725
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:42897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:02.051712 25288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:02.052141 25288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:02.052232 25288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:02.057536 25288 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 17:01:02.057662 25288 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 17:01:02.057688 25288 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 17:01:02.057711 25288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:02.057755 25288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:02.057821 25288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:02.057880 25288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:02.057920 25288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:02.064255 25288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:42897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:42897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=44725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:02.065611 25288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:02.066761 25288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:02.076339 25294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:02.076339 25296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:02.076412 25293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:02.076766 25288 server_base.cc:1034] running on GCE node
I20260806 17:01:02.077493 25288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:02.078909 25288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:02.080164 25288 hybrid_clock.cc:648] HybridClock initialized: now 1786035662080127 us; error 53 us; skew 500 ppm
Aug 06 17:01:02 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035662, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:02.083460 25288 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:02.084544 25288 webserver.cc:460] Webserver started at http://127.7.153.62:44725/ using document root <none> and password file <none>
I20260806 17:01:02.085237 25288 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:02.085340 25288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:02.089865 25288 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 17:01:02.092530 25304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.094126 25288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 17:01:02.094329 25288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "ed76d684c79b48f5933eab7e63412138"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "1d5448fb0127547f6063eff1bf7e425d"
server_key_iv: "cdd9b073c0b4242997da15993e973e20"
server_key_version: "encryptionkey@0"
I20260806 17:01:02.095014 25288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:02.115142 25288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:02.119004 25288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:02.119269 25288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:02.127839 25288 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:42897
I20260806 17:01:02.128226 25362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:42897 every 8 connection(s)
I20260806 17:01:02.129194 25288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:02.136504 25363 sys_catalog.cc:263] Verifying existing consensus state
I20260806 17:01:02.138425 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 25288
I20260806 17:01:02.138959 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:35061
--local_ip_for_outbound_sockets=127.7.153.1
--tserver_master_addrs=127.7.153.62:42897
--webserver_port=45269
--webserver_interface=127.7.153.1
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:01:02.139056 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap starting.
I20260806 17:01:02.159389 25363 log.cc:824] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:02.172490 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:01:02.173020 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Bootstrap complete.
I20260806 17:01:02.178752 25363 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:01:02.179242 25363 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed76d684c79b48f5933eab7e63412138, State: Initialized, Role: FOLLOWER
I20260806 17:01:02.179872 25363 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:01:02.180043 25363 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:02.180131 25363 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:02.180263 25363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 2 FOLLOWER]: Advancing to term 3
I20260806 17:01:02.182726 25363 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:01:02.183209 25363 leader_election.cc:302] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed76d684c79b48f5933eab7e63412138; no voters:
I20260806 17:01:02.183624 25363 leader_election.cc:288] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 17:01:02.183743 25367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 17:01:02.183967 25367 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [term 3 LEADER]: Becoming Leader. State: Replica: ed76d684c79b48f5933eab7e63412138, State: Running, Role: LEADER
I20260806 17:01:02.184376 25367 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } }
I20260806 17:01:02.185099 25363 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:02.185554 25367 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed76d684c79b48f5933eab7e63412138. Latest consensus state: current_term: 3 leader_uuid: "ed76d684c79b48f5933eab7e63412138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } } }
I20260806 17:01:02.185777 25367 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:02.186090 25368 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ed76d684c79b48f5933eab7e63412138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed76d684c79b48f5933eab7e63412138" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 42897 } } }
I20260806 17:01:02.186280 25368 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:02.186617 25371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:02.193260 25371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:02.194798 25371 catalog_manager.cc:1259] Loaded cluster ID: 7f9acf9789f5471691ffc470e0323b54
I20260806 17:01:02.195111 25371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:02.198297 25371 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:02.199368 25371 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Loaded TSK: 0
I20260806 17:01:02.199476 25371 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ed76d684c79b48f5933eab7e63412138: Loaded TSK: 1
F20260806 17:01:02.200412 25371 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa60cc429ad google::LogMessage::Fail() at ??:0
@ 0x7fa60cc4588a google::LogMessage::SendToLog() at ??:0
@ 0x7fa60cc424de google::LogMessage::Flush() at ??:0
@ 0x7fa60cc43a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa60f90618d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fa60f8fef0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fa6175a77bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fa61758199c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fa617582178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fa6175c3df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fa6175e282b std::function<>::operator()() at ??:0
@ 0x7fa617581b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fa617582f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa61757f579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fa6175c3640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fa60ee943d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa60ee94c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fa60ee963f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fa60ee85512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa6104c96db start_thread at ??:0
@ 0x7fa60b74061f clone at ??:0
W20260806 17:01:02.302000 25365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:02.302393 25365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:02.302464 25365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:02.309319 25365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:02.309401 25365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:02.309502 25365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:02.318526 25365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:35061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=45269
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:02.320082 25365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:02.321566 25365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:02.335417 25414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:02.335486 25413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:02.335435 25416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:02.336061 25365 server_base.cc:1034] running on GCE node
I20260806 17:01:02.336561 25365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:02.337467 25365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:02.338845 25365 hybrid_clock.cc:648] HybridClock initialized: now 1786035662338814 us; error 49 us; skew 500 ppm
Aug 06 17:01:02 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035662, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:02.342245 25365 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:01:02.343362 25365 webserver.cc:460] Webserver started at http://127.7.153.1:45269/ using document root <none> and password file <none>
I20260806 17:01:02.344020 25365 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:02.344091 25365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:02.349470 25365 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:02.352188 25423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.353847 25365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:02.354053 25365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "61c514cec792ba4ba3b774a55894d02c"
server_key_iv: "ff11cd2fa37cf5afccad768b3b1b53c3"
server_key_version: "encryptionkey@0"
I20260806 17:01:02.354705 25365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:02.374811 25365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:02.378778 25365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:02.379014 25365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:02.379695 25365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:02.381057 25431 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 17:01:02.387676 25365 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 17:01:02.387825 25365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.000s
I20260806 17:01:02.387953 25365 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 17:01:02.390208 25365 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 17:01:02.390303 25365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 17:01:02.390749 25431 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap starting.
I20260806 17:01:02.402976 25365 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:35061
I20260806 17:01:02.403100 25546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:35061 every 8 connection(s)
I20260806 17:01:02.404315 25365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:02.409093 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 25365
I20260806 17:01:02.409605 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:46387
--local_ip_for_outbound_sockets=127.7.153.2
--tserver_master_addrs=127.7.153.62:42897
--webserver_port=38037
--webserver_interface=127.7.153.2
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:01:02.416309 25431 log.cc:824] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:02.427681 25431 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 17:01:02.428277 25431 tablet_bootstrap.cc:492] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Bootstrap complete.
I20260806 17:01:02.430042 25431 ts_tablet_manager.cc:1397] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent bootstrapping tablet: real 0.040s user 0.022s sys 0.016s
I20260806 17:01:02.434285 25431 raft_consensus.cc:348] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:01:02.435015 25431 raft_consensus.cc:729] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3169aa4f2e1140e1a679e1aa7e40fa7d, State: Initialized, Role: FOLLOWER
I20260806 17:01:02.435756 25431 consensus_queue.cc:260] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:01:02.437234 25431 ts_tablet_manager.cc:1428] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
W20260806 17:01:02.487860 25549 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:02.406641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:44761)
0806 17:01:02.407194 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.407256 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:02.408280 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:02.486838 (+ 78558us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":167,"threads_started":1}
W20260806 17:01:02.488597 25547 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:42897 (0 consecutive failures): Network error: Failed to ping master at 127.7.153.62:42897: Client connection negotiation failed: client connection to 127.7.153.62:42897: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 17:01:02.489612 25549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.489230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:58039)
0806 17:01:02.489400 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.489492 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 17:01:02.490471 25549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.490219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:38775)
0806 17:01:02.490341 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.490393 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 17:01:02.490805 25547 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 17:01:02.542589 25550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:02.542937 25550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:02.543054 25550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:02.547375 25550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:02.547495 25550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:02.547598 25550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:02.554131 25550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:46387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=38037
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:02.555465 25550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:02.556633 25550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:02.568594 25558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:02.568599 25559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:02.568658 25550 server_base.cc:1034] running on GCE node
W20260806 17:01:02.568588 25561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:02.569451 25550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:02.570182 25550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:02.571380 25550 hybrid_clock.cc:648] HybridClock initialized: now 1786035662571347 us; error 55 us; skew 500 ppm
Aug 06 17:01:02 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035662, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:02.574690 25550 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:01:02.575793 25550 webserver.cc:460] Webserver started at http://127.7.153.2:38037/ using document root <none> and password file <none>
I20260806 17:01:02.576444 25550 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:02.576545 25550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:02.582520 25550 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:02.585925 25568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.587901 25550 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:02.588193 25550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "72692541b3f8481bbb60084edda93e61"
format_stamp: "Formatted at 2026-08-06 17:00:19 on dist-test-slave-cbsf"
server_key: "dc1b2cd709f5064f699d751f21b8b1e5"
server_key_iv: "3b69bf452968543ce0a3beb028edeaf5"
server_key_version: "encryptionkey@0"
I20260806 17:01:02.589262 25550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:02.610301 25550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:02.613948 25550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:02.614310 25550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:02.615041 25550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:02.616000 25550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:02.616078 25550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.616154 25550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:02.616197 25550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.626827 25550 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:46387
I20260806 17:01:02.626849 25689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:46387 every 8 connection(s)
I20260806 17:01:02.627956 25550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:01:02.632014 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.630367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:54047)
0806 17:01:02.631119 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.631237 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":126,"threads_started":1}
W20260806 17:01:02.632544 25690 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:42897 (0 consecutive failures): Network error: Failed to ping master at 127.7.153.62:42897: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
I20260806 17:01:02.633270 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.633032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:45273)
0806 17:01:02.633157 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.633210 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 17:01:02.633884 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 25550
I20260806 17:01:02.634109 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.633827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:42565)
0806 17:01:02.633962 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.634048 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 17:01:02.634320 25690 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 17:01:02.634505 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:46737
--local_ip_for_outbound_sockets=127.7.153.3
--tserver_master_addrs=127.7.153.62:42897
--webserver_port=39441
--webserver_interface=127.7.153.3
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:02.757701 25693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:02.758023 25693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:02.758111 25693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:02.762564 25693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:02.762642 25693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:02.762743 25693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:02.768611 25693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:46737
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=39441
--tserver_master_addrs=127.7.153.62:42897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:02.769939 25693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:02.771080 25693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:02.781822 25698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:02.781834 25693 server_base.cc:1034] running on GCE node
W20260806 17:01:02.781853 25699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:02.781831 25701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:02.782606 25693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:02.783339 25693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:02.784562 25693 hybrid_clock.cc:648] HybridClock initialized: now 1786035662784523 us; error 54 us; skew 500 ppm
Aug 06 17:01:02 dist-test-slave-cbsf krb5kdc[24124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035662, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:02.791818 25693 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:01:02.793092 25693 webserver.cc:460] Webserver started at http://127.7.153.3:39441/ using document root <none> and password file <none>
I20260806 17:01:02.793808 25693 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:02.793913 25693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:02.798506 25693 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 17:01:02.801121 25708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.802671 25693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 17:01:02.802865 25693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "8f98add19a3f4cbe929e08dabdcaf8c9"
format_stamp: "Formatted at 2026-08-06 17:00:20 on dist-test-slave-cbsf"
server_key: "9fc2c032f0a0a4d16516d98eaf787ef7"
server_key_iv: "045be8423ac89552510a070390592882"
server_key_version: "encryptionkey@0"
I20260806 17:01:02.803551 25693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:02.827210 25693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:02.830952 25693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:02.831245 25693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:02.831996 25693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:02.833072 25693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:02.833173 25693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.833256 25693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:02.833312 25693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:02.844583 25693 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:46737
I20260806 17:01:02.844600 25828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:46737 every 8 connection(s)
I20260806 17:01:02.845908 25693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:02.850379 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.848577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:53429)
0806 17:01:02.849463 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.849582 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":151,"threads_started":1}
W20260806 17:01:02.851190 25829 heartbeater.cc:644] Failed to heartbeat to 127.7.153.62:42897 (0 consecutive failures): Network error: Failed to ping master at 127.7.153.62:42897: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
I20260806 17:01:02.852264 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.851996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:37083)
0806 17:01:02.852140 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.852201 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 17:01:02.853264 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:02.853013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:53777)
0806 17:01:02.853120 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:02.853177 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 17:01:02.853487 25829 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 17:01:02.853570 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 25693
I20260806 17:01:03.492156 25833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:03.491622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:46757)
0806 17:01:03.491958 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:03.492033 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":86,"threads_started":1}
I20260806 17:01:03.635576 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:03.635056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:33161)
0806 17:01:03.635370 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:03.635435 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":96,"threads_started":1}
I20260806 17:01:03.855084 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:03.854405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:38945)
0806 17:01:03.854855 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:03.854946 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":111,"threads_started":1}
I20260806 17:01:04.185355 25836 raft_consensus.cc:482] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:04.185599 25836 raft_consensus.cc:504] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:01:04.186838 25836 leader_election.cc:288] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
Aug 06 17:01:04 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035662, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.3@KRBTEST.COM
Aug 06 17:01:04 dist-test-slave-cbsf krb5kdc[24124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035662, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.2@KRBTEST.COM
I20260806 17:01:04.205484 25837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.187092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46737 (local address 127.7.153.1:42457)
0806 17:01:04.187379 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:04.187395 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:04.187588 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:04.189976 (+ 2388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:04.189983 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:04.190716 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:04.191640 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:04.191666 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.194051 (+ 2385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.194055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:04.195094 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:04.195107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.195966 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.195970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:04.196175 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:04.196964 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:04.196987 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:04.198779 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:04.201658 (+ 2879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:04.201667 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:04.201686 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:04.202267 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:04.203157 (+ 890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:04.203161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:04.203163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:04.203307 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:04.204075 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:04.204084 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:04.204517 (+ 433us) client_negotiation.cc:769] Sending connection context
0806 17:01:04.204791 (+ 274us) client_negotiation.cc:240] Negotiation successful
0806 17:01:04.205244 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":270,"spinlock_wait_cycles":18176,"thread_start_us":85,"threads_started":1}
I20260806 17:01:04.205509 25839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.187319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:56967 (local address 127.7.153.2:46387)
0806 17:01:04.187843 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:04.187854 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:04.187888 (+ 34us) server_negotiation.cc:407] Connection header received
0806 17:01:04.188919 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:04.188929 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:04.189450 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:04.189843 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:04.191870 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.193842 (+ 1972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.195223 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.195750 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.195911 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:04.199390 (+ 3479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:04.199395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:04.199406 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:04.199438 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:04.201646 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:04.202457 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:04.202462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:04.202467 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:04.202678 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:04.203207 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:04.203210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:04.203212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:04.203888 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:04.204049 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:04.204943 (+ 894us) server_negotiation.cc:299] Negotiation successful
0806 17:01:04.205291 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":82,"threads_started":1}
I20260806 17:01:04.205504 25840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.187428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:42457 (local address 127.7.153.3:46737)
0806 17:01:04.187806 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:04.187837 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:04.187889 (+ 52us) server_negotiation.cc:407] Connection header received
0806 17:01:04.188919 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:04.188929 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:04.189450 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:04.189843 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:04.192103 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.193842 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.195282 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.195793 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.196005 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:04.199105 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:04.199114 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:04.199134 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:04.199175 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:04.201464 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:04.202450 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:04.202460 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:04.202486 (+ 26us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:04.203018 (+ 532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:04.203422 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:04.203426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:04.203428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:04.203895 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:04.204040 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:04.204943 (+ 903us) server_negotiation.cc:299] Negotiation successful
0806 17:01:04.205300 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":120,"threads_started":1}
I20260806 17:01:04.205483 25838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.187201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:46387 (local address 127.7.153.1:56967)
0806 17:01:04.187591 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:04.187604 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:04.187694 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:04.189976 (+ 2282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:04.189983 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:04.190716 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:04.191640 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:04.191666 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.194073 (+ 2407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.194077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:04.195088 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:04.195103 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:04.195903 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:04.195911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:04.196183 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:04.196911 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:04.196930 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:04.199156 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:04.201774 (+ 2618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:04.201778 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:04.201779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:04.202267 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:04.202844 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:04.202847 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:04.202848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:04.203072 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:04.204075 (+ 1003us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:04.204084 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:04.204517 (+ 433us) client_negotiation.cc:769] Sending connection context
0806 17:01:04.204791 (+ 274us) client_negotiation.cc:240] Negotiation successful
0806 17:01:04.205300 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":499,"spinlock_wait_cycles":38528,"thread_start_us":84,"threads_started":1}
W20260806 17:01:04.209071 25424 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
W20260806 17:01:04.209259 25425 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:01:04.209306 25424 leader_election.cc:302] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d; no voters: 72692541b3f8481bbb60084edda93e61, 8f98add19a3f4cbe929e08dabdcaf8c9
I20260806 17:01:04.209617 25836 raft_consensus.cc:2726] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:01:04.493731 25838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.493382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:37575)
0806 17:01:04.493554 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:04.493634 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 17:01:04.637275 25841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.636677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:55259)
0806 17:01:04.637062 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:04.637125 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":110,"threads_started":1}
I20260806 17:01:04.856487 25842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:04.856040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:40331)
0806 17:01:04.856315 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:04.856377 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":86,"threads_started":1}
I20260806 17:01:05.495347 25843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:05.494872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:50903)
0806 17:01:05.495165 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:05.495240 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":76,"threads_started":1}
I20260806 17:01:05.638712 25844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:05.638173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:42421)
0806 17:01:05.638510 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:05.638578 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":113,"threads_started":1}
I20260806 17:01:05.857861 25845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:05.857415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:42995)
0806 17:01:05.857683 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:05.857743 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":98,"threads_started":1}
I20260806 17:01:06.069213 25846 raft_consensus.cc:482] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:06.069386 25846 raft_consensus.cc:504] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:01:06.069938 25846 leader_election.cc:288] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
W20260806 17:01:06.070833 25424 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
W20260806 17:01:06.070940 25425 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:01:06.071015 25425 leader_election.cc:302] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d; no voters: 72692541b3f8481bbb60084edda93e61, 8f98add19a3f4cbe929e08dabdcaf8c9
I20260806 17:01:06.071173 25846 raft_consensus.cc:2726] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:01:06.496666 25847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:06.496217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:52281)
0806 17:01:06.496499 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:06.496562 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":88,"threads_started":1}
I20260806 17:01:06.640326 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:06.639804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:37929)
0806 17:01:06.640131 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:06.640222 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":97,"threads_started":1}
I20260806 17:01:06.859521 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:06.859008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:35637)
0806 17:01:06.859306 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:06.859375 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":90,"threads_started":1}
I20260806 17:01:07.498492 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:07.497874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:59557)
0806 17:01:07.498277 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:07.498346 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":115,"threads_started":1}
I20260806 17:01:07.641834 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:07.641365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:53897)
0806 17:01:07.641650 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:07.641718 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":90,"threads_started":1}
I20260806 17:01:07.861332 25852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:07.860869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:37539)
0806 17:01:07.861143 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:07.861209 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":82,"threads_started":1}
I20260806 17:01:08.495260 25853 raft_consensus.cc:482] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:08.495406 25853 raft_consensus.cc:504] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:01:08.495882 25853 leader_election.cc:288] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
W20260806 17:01:08.496765 25425 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
W20260806 17:01:08.496856 25424 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:01:08.497059 25424 leader_election.cc:302] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d; no voters: 72692541b3f8481bbb60084edda93e61, 8f98add19a3f4cbe929e08dabdcaf8c9
I20260806 17:01:08.497277 25853 raft_consensus.cc:2726] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:01:08.499740 25854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:08.499298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:39151)
0806 17:01:08.499566 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:08.499645 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":76,"threads_started":1}
I20260806 17:01:08.643433 25855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:08.642896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:49941)
0806 17:01:08.643259 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:08.643327 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":120,"threads_started":1}
I20260806 17:01:08.862864 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:08.862248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:51159)
0806 17:01:08.862633 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:08.862705 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":153,"threads_started":1}
I20260806 17:01:09.501332 25857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:09.500633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:44419)
0806 17:01:09.501121 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:09.501195 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":171,"threads_started":1}
I20260806 17:01:09.645174 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:09.644543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:46003)
0806 17:01:09.644992 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:09.645058 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":198,"threads_started":1}
I20260806 17:01:09.864500 25859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:09.863934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:45465)
0806 17:01:09.864315 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:09.864394 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":82,"threads_started":1}
I20260806 17:01:10.503340 25860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:10.502448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:50441)
0806 17:01:10.503083 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:10.503189 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":89,"threads_started":1}
I20260806 17:01:10.646812 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:10.646113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:52559)
0806 17:01:10.646559 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:10.646667 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":86,"threads_started":1}
I20260806 17:01:10.866452 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:10.865731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:39273)
0806 17:01:10.866224 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:10.866327 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":150,"threads_started":1}
I20260806 17:01:10.963790 25863 raft_consensus.cc:482] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:10.963963 25863 raft_consensus.cc:504] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f98add19a3f4cbe929e08dabdcaf8c9" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46737 } } peers { permanent_uuid: "3169aa4f2e1140e1a679e1aa7e40fa7d" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 35061 } } peers { permanent_uuid: "72692541b3f8481bbb60084edda93e61" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 46387 } }
I20260806 17:01:10.964504 25863 leader_election.cc:288] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737), 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387)
W20260806 17:01:10.965482 25425 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8f98add19a3f4cbe929e08dabdcaf8c9 (127.7.153.3:46737): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
W20260806 17:01:10.965636 25424 leader_election.cc:341] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 72692541b3f8481bbb60084edda93e61 (127.7.153.2:46387): Not found: Tablet not found: 3b708aeeb81742e8b3c53a5798afc4e4
I20260806 17:01:10.965739 25424 leader_election.cc:302] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3169aa4f2e1140e1a679e1aa7e40fa7d; no voters: 72692541b3f8481bbb60084edda93e61, 8f98add19a3f4cbe929e08dabdcaf8c9
I20260806 17:01:10.965935 25863 raft_consensus.cc:2726] T 3b708aeeb81742e8b3c53a5798afc4e4 P 3169aa4f2e1140e1a679e1aa7e40fa7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 17:01:11.504999 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:11.504419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:37893)
0806 17:01:11.504817 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:11.504886 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":95,"threads_started":1}
I20260806 17:01:11.648828 25865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:11.648153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:49023)
0806 17:01:11.648541 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:11.648620 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":158,"threads_started":1}
I20260806 17:01:11.868127 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:11.867593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:52399)
0806 17:01:11.867950 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:11.868022 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":104,"threads_started":1}
I20260806 17:01:12.506855 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:12.506313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:35421)
0806 17:01:12.506679 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:12.506754 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":119,"threads_started":1}
I20260806 17:01:12.650770 25868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:12.650195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:37137)
0806 17:01:12.650564 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:12.650635 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":122,"threads_started":1}
I20260806 17:01:12.869957 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:12.869365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:51731)
0806 17:01:12.869781 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:12.869851 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":111,"threads_started":1}
I20260806 17:01:13.508428 25871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:13.507829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:56219)
0806 17:01:13.508204 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:13.508288 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":88,"threads_started":1}
I20260806 17:01:13.652115 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:13.651630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:41597)
0806 17:01:13.651943 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:13.651999 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":113,"threads_started":1}
I20260806 17:01:13.871479 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:13.870967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:36689)
0806 17:01:13.871280 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:13.871374 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":95,"threads_started":1}
I20260806 17:01:14.509910 25874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:14.509446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:48805)
0806 17:01:14.509738 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:14.509804 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
I20260806 17:01:14.653455 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:14.652995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:41113)
0806 17:01:14.653287 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:14.653351 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":84,"threads_started":1}
I20260806 17:01:14.873493 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:14.872666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:40313)
0806 17:01:14.873227 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:14.873333 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":107,"threads_started":1}
I20260806 17:01:15.511335 25878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:15.510844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:54073)
0806 17:01:15.511158 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:15.511224 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":98,"threads_started":1}
I20260806 17:01:15.654934 25879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:15.654419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:50095)
0806 17:01:15.654747 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:15.654825 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":89,"threads_started":1}
I20260806 17:01:15.874982 25880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:15.874471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:50703)
0806 17:01:15.874779 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:15.874862 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":115,"threads_started":1}
I20260806 17:01:16.512825 25881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:16.512308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:52789)
0806 17:01:16.512589 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:16.512666 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":105,"threads_started":1}
I20260806 17:01:16.656821 25882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:16.656197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:56769)
0806 17:01:16.656526 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:16.656597 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":88,"threads_started":1}
I20260806 17:01:16.876472 25883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:16.875968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:33579)
0806 17:01:16.876302 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:16.876368 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":113,"threads_started":1}
I20260806 17:01:17.514447 25884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:17.513919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.1:33713)
0806 17:01:17.514249 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:17.514316 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":114,"threads_started":1}
I20260806 17:01:17.658599 25885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:17.658032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.2:53117)
0806 17:01:17.658416 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:17.658484 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":91,"threads_started":1}
I20260806 17:01:17.863780 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 25365
I20260806 17:01:17.873317 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 25550
I20260806 17:01:17.878068 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:17.877628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:42897 (local address 127.7.153.3:56037)
0806 17:01:17.877898 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:17.877966 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.62:42897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":101,"threads_started":1}
I20260806 17:01:17.882396 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 25693
2026-08-06T17:01:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59970 ms)
[----------] 30 tests from SecurityITest (261244 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:17 dist-test-slave-cbsf krb5kdc[25889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:17 dist-test-slave-cbsf krb5kdc[25889](info): set up 2 sockets
Aug 06 17:01:17 dist-test-slave-cbsf krb5kdc[25889](info): commencing operation
krb5kdc: starting...
W20260806 17:01:18.995559 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:19.145077 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34299
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34299
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:19.273066 25902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:19.273394 25902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:19.273438 25902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:19.277786 25902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:19.277875 25902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:19.277896 25902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:19.277913 25902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:19.277930 25902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:19.284938 25902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:19.286192 25902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:19.287259 25902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:19.297042 25908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:19.297104 25902 server_base.cc:1034] running on GCE node
W20260806 17:01:19.297037 25911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:19.297047 25907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:19.298089 25902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:19.299506 25902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:19.300933 25902 hybrid_clock.cc:648] HybridClock initialized: now 1786035679300876 us; error 62 us; skew 500 ppm
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:19.304641 25902 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:19.305871 25902 webserver.cc:460] Webserver started at http://127.7.153.62:40171/ using document root <none> and password file <none>
I20260806 17:01:19.306540 25902 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:19.306613 25902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:19.306875 25902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:19.309425 25902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "4b9556be5f644d74ad59a1fb89d4292f"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "402e5aa16785950c8460cd1252cea758"
server_key_iv: "9a129b82277d07d22da733721675e5a4"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.310137 25902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "4b9556be5f644d74ad59a1fb89d4292f"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "402e5aa16785950c8460cd1252cea758"
server_key_iv: "9a129b82277d07d22da733721675e5a4"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.314719 25902 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 17:01:19.318017 25918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.319916 25902 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 17:01:19.320116 25902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "4b9556be5f644d74ad59a1fb89d4292f"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "402e5aa16785950c8460cd1252cea758"
server_key_iv: "9a129b82277d07d22da733721675e5a4"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.320297 25902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:19.336920 25902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:19.341922 25902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:19.342247 25902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:19.350943 25902 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34299
I20260806 17:01:19.350977 25973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34299 every 8 connection(s)
I20260806 17:01:19.352150 25902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:19.354799 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 25902
I20260806 17:01:19.354997 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:19.355338 7780 external_mini_cluster.cc:1428] Setting key 6a04708b4dafbf26ae4ae73878e48d72
I20260806 17:01:19.355695 25974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:19.364338 25974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: Bootstrap starting.
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:19.367034 25974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:19.368184 25974 log.cc:824] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:19.370995 25974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: No bootstrap required, opened a new log
I20260806 17:01:19.373549 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:19.357357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.7.153.62:34299)
0806 17:01:19.357854 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:19.357879 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:19.357925 (+ 46us) server_negotiation.cc:407] Connection header received
0806 17:01:19.359026 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:19.359057 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:19.359557 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:19.360020 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:19.360894 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.362458 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.363442 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.364176 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.364349 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:19.367187 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:19.367195 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:19.367219 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:19.367260 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:19.369510 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:19.370078 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:19.370085 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:19.370092 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:19.370244 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:19.370848 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:19.370851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:19.370853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:19.371454 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:19.371690 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:19.372046 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 17:01:19.372441 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":143,"threads_started":1}
I20260806 17:01:19.375919 25974 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9556be5f644d74ad59a1fb89d4292f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34299 } }
I20260806 17:01:19.376255 25974 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:19.376358 25974 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b9556be5f644d74ad59a1fb89d4292f, State: Initialized, Role: FOLLOWER
I20260806 17:01:19.376902 25974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9556be5f644d74ad59a1fb89d4292f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34299 } }
I20260806 17:01:19.377069 25974 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:19.377139 25974 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:19.377290 25974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:19.378549 25974 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9556be5f644d74ad59a1fb89d4292f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34299 } }
I20260806 17:01:19.378961 25974 leader_election.cc:302] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b9556be5f644d74ad59a1fb89d4292f; no voters:
I20260806 17:01:19.379333 25974 leader_election.cc:288] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:19.379747 25979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:19.380141 25979 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [term 1 LEADER]: Becoming Leader. State: Replica: 4b9556be5f644d74ad59a1fb89d4292f, State: Running, Role: LEADER
I20260806 17:01:19.380638 25979 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9556be5f644d74ad59a1fb89d4292f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34299 } }
I20260806 17:01:19.380811 25974 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:19.382678 25980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b9556be5f644d74ad59a1fb89d4292f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9556be5f644d74ad59a1fb89d4292f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34299 } } }
I20260806 17:01:19.382921 25980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:19.382709 25981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b9556be5f644d74ad59a1fb89d4292f. Latest consensus state: current_term: 1 leader_uuid: "4b9556be5f644d74ad59a1fb89d4292f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b9556be5f644d74ad59a1fb89d4292f" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34299 } } }
I20260806 17:01:19.383179 25981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f [sys.catalog]: This master's current role is: LEADER
W20260806 17:01:19.386795 25995 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:19.386914 25995 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:19.387041 25994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:19.388154 25994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:19.394508 25994 catalog_manager.cc:1347] Generated new cluster ID: f036c02b2dc14275b66384339ddee75e
I20260806 17:01:19.394634 25994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:19.411540 25994 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:19.412931 25994 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:19.418999 25994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: Generated new TSK 0
I20260806 17:01:19.419929 25994 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 17:01:19.460987 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34299
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:19.589700 26001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:19.590011 26001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:19.590111 26001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:19.594540 26001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:19.594646 26001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:19.594733 26001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:19.600378 26001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:19.601634 26001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:19.602794 26001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:19.614749 26011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:19.614753 26007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:19.614902 26001 server_base.cc:1034] running on GCE node
W20260806 17:01:19.614749 26009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:19.615535 26001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:19.616264 26001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:19.617467 26001 hybrid_clock.cc:648] HybridClock initialized: now 1786035679617400 us; error 87 us; skew 500 ppm
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:19.621146 26001 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:01:19.622318 26001 webserver.cc:460] Webserver started at http://127.7.153.1:37091/ using document root <none> and password file <none>
I20260806 17:01:19.622982 26001 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:19.623083 26001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:19.623334 26001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:19.626906 26001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "2505e54c910243788a549062d0f6d5ea"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "5e7b10bd4840463deec217af0c7553d4"
server_key_iv: "b17c823b4861ac9b2335c2eabc2393d0"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.627707 26001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "2505e54c910243788a549062d0f6d5ea"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "5e7b10bd4840463deec217af0c7553d4"
server_key_iv: "b17c823b4861ac9b2335c2eabc2393d0"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.632375 26001 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 17:01:19.635908 26018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.637903 26001 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:19.638154 26001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "2505e54c910243788a549062d0f6d5ea"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "5e7b10bd4840463deec217af0c7553d4"
server_key_iv: "b17c823b4861ac9b2335c2eabc2393d0"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.638316 26001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:19.655675 26001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:19.659960 26001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:19.660238 26001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:19.660938 26001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:19.662194 26001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:19.662302 26001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.662396 26001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:19.662458 26001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.673918 26001 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:42547
I20260806 17:01:19.673954 26140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:42547 every 8 connection(s)
I20260806 17:01:19.675005 26001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:19.681910 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26001
I20260806 17:01:19.682085 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:01:19.682497 7780 external_mini_cluster.cc:1428] Setting key 74513a97626a6c17c4e83d85265f79fe
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:19.692843 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:19.677210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:38757 (local address 127.7.153.62:34299)
0806 17:01:19.677389 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:19.677393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:19.678938 (+ 1545us) server_negotiation.cc:407] Connection header received
0806 17:01:19.680126 (+ 1188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:19.680130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:19.680198 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:19.680397 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:19.682318 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.683084 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.684577 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.684895 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.684992 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:19.688156 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:19.688163 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:19.688170 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:19.688207 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:19.690238 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:19.690858 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:19.690864 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:19.690866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:19.690973 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:19.691351 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:19.691357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:19.691362 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:19.691690 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:19.691817 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:19.692414 (+ 597us) server_negotiation.cc:299] Negotiation successful
0806 17:01:19.692577 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 17:01:19.693789 26143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:19.677608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34299 (local address 127.7.153.1:38757)
0806 17:01:19.678640 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:19.678746 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:19.679817 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:19.680788 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:19.680804 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:19.681315 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:19.682088 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:19.682110 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.683245 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.683249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:19.684384 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:19.684398 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.685080 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.685087 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:19.685353 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:19.686104 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:19.686133 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:19.687938 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:19.690395 (+ 2457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:19.690401 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:19.690420 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:19.690736 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:19.691084 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:19.691086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:19.691087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:19.691245 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:19.691842 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:19.691848 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:19.692141 (+ 293us) client_negotiation.cc:769] Sending connection context
0806 17:01:19.692321 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 17:01:19.692633 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":135,"threads_started":1}
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 17:01:19.695642 26141 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34299
I20260806 17:01:19.696156 26141 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:19.697358 26141 heartbeater.cc:511] Master 127.7.153.62:34299 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 17:01:19.699576 25937 ts_manager.cc:194] Registered new tserver with Master: 2505e54c910243788a549062d0f6d5ea (127.7.153.1:42547)
I20260806 17:01:19.701328 25937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:38757
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 17:01:19.716749 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34299
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:19.844465 26146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:19.844897 26146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:19.844995 26146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:19.849464 26146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:19.849562 26146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:19.849663 26146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:19.855655 26146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:19.857002 26146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:19.858181 26146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:19.869697 26153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:19.869727 26155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:19.869697 26152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:19.870023 26146 server_base.cc:1034] running on GCE node
I20260806 17:01:19.870587 26146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:19.871330 26146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:19.872538 26146 hybrid_clock.cc:648] HybridClock initialized: now 1786035679872506 us; error 46 us; skew 500 ppm
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:19.876061 26146 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:01:19.877300 26146 webserver.cc:460] Webserver started at http://127.7.153.2:40259/ using document root <none> and password file <none>
I20260806 17:01:19.877951 26146 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:19.878062 26146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:19.878319 26146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:19.880581 26146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "74a820e2162dfc6bd1d1787de43e06c3"
server_key_iv: "0187cb70bb600fcb9dc758ddc628a4da"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.881300 26146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "74a820e2162dfc6bd1d1787de43e06c3"
server_key_iv: "0187cb70bb600fcb9dc758ddc628a4da"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.886514 26146 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 17:01:19.889667 26162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.891358 26146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:19.891568 26146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289"
format_stamp: "Formatted at 2026-08-06 17:01:19 on dist-test-slave-cbsf"
server_key: "74a820e2162dfc6bd1d1787de43e06c3"
server_key_iv: "0187cb70bb600fcb9dc758ddc628a4da"
server_key_version: "encryptionkey@0"
I20260806 17:01:19.891737 26146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:19.905941 26146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:19.911022 26146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:19.911342 26146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:19.912149 26146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:19.913305 26146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:19.913389 26146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.913475 26146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:19.913524 26146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:19.924731 26146 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:44727
I20260806 17:01:19.924762 26284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:44727 every 8 connection(s)
I20260806 17:01:19.925922 26146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:01:19.926302 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26146
I20260806 17:01:19.926431 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:01:19.926836 7780 external_mini_cluster.cc:1428] Setting key 5e820ac83c07d641fbfb5257ce142ce9
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Aug 06 17:01:19 dist-test-slave-cbsf krb5kdc[25889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035679, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 17:01:19.943495 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:19.928298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:45137 (local address 127.7.153.62:34299)
0806 17:01:19.928444 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:19.928450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:19.930051 (+ 1601us) server_negotiation.cc:407] Connection header received
0806 17:01:19.931588 (+ 1537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:19.931591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:19.931667 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:19.931786 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:19.933300 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.933901 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.935292 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.935562 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.935695 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:19.938843 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:19.938846 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:19.938849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:19.938881 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:19.940589 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:19.941496 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:19.941500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:19.941503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:19.941644 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:19.942036 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:19.942042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:19.942046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:19.942352 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:19.942469 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:19.943055 (+ 586us) server_negotiation.cc:299] Negotiation successful
0806 17:01:19.943233 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 17:01:19.944358 26287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:19.928887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34299 (local address 127.7.153.2:45137)
0806 17:01:19.929848 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:19.929921 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:19.931322 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:19.931998 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:19.932007 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:19.932447 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:19.933122 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:19.933140 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.934068 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.934077 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:19.935132 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:19.935145 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:19.935753 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:19.935758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:19.935957 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:19.936748 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:19.936780 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:19.938592 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:19.940826 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:19.940835 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:19.940860 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:19.941340 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:19.941768 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:19.941770 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:19.941772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:19.941929 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:19.942465 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:19.942471 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:19.942774 (+ 303us) client_negotiation.cc:769] Sending connection context
0806 17:01:19.942948 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 17:01:19.943320 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":136,"threads_started":1}
I20260806 17:01:19.945847 26285 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34299
I20260806 17:01:19.946168 26285 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:19.946805 26285 heartbeater.cc:511] Master 127.7.153.62:34299 requested a full tablet report, sending...
I20260806 17:01:19.948208 25937 ts_manager.cc:194] Registered new tserver with Master: a8b8cbe5d3024c2ab6528fdf9ef46289 (127.7.153.2:44727)
I20260806 17:01:19.948918 25937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:45137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 17:01:19.959981 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34299
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:20.085855 26291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:20.086184 26291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:20.086229 26291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:20.090631 26291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:20.090720 26291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:20.090785 26291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:20.096829 26291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:20.098165 26291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:20.099285 26291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:20.109678 26301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:20.109699 26298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:20.109678 26297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:20.110093 26291 server_base.cc:1034] running on GCE node
I20260806 17:01:20.110561 26291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:20.111295 26291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:20.112493 26291 hybrid_clock.cc:648] HybridClock initialized: now 1786035680112476 us; error 29 us; skew 500 ppm
Aug 06 17:01:20 dist-test-slave-cbsf krb5kdc[25889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035680, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:20.115626 26291 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:01:20.116679 26291 webserver.cc:460] Webserver started at http://127.7.153.3:40679/ using document root <none> and password file <none>
I20260806 17:01:20.117385 26291 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:20.117486 26291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:20.117743 26291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:20.119993 26291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "7e932ba0098347cf96c81f45126a8a1f"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "9f90dbdb579436e55b0e628ca53b8b4d"
server_key_iv: "cb96b4f7d308e36ed31b37592994c6d8"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.120643 26291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "7e932ba0098347cf96c81f45126a8a1f"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "9f90dbdb579436e55b0e628ca53b8b4d"
server_key_iv: "cb96b4f7d308e36ed31b37592994c6d8"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.125275 26291 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 17:01:20.128166 26309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.129599 26291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:20.129765 26291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "7e932ba0098347cf96c81f45126a8a1f"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "9f90dbdb579436e55b0e628ca53b8b4d"
server_key_iv: "cb96b4f7d308e36ed31b37592994c6d8"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.129906 26291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:20.160804 26291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:20.164551 26291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:20.164817 26291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:20.165499 26291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:20.166443 26291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:20.166517 26291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.166594 26291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:20.166639 26291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.176534 26291 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:36749
I20260806 17:01:20.176563 26430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:36749 every 8 connection(s)
I20260806 17:01:20.177673 26291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:20.179191 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26291
I20260806 17:01:20.179355 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:01:20.179729 7780 external_mini_cluster.cc:1428] Setting key b5baf1f17dbe1ccf712448a68f11a167
Aug 06 17:01:20 dist-test-slave-cbsf krb5kdc[25889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035680, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:20.193624 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.179929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:33741 (local address 127.7.153.62:34299)
0806 17:01:20.180113 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.180118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.181237 (+ 1119us) server_negotiation.cc:407] Connection header received
0806 17:01:20.182421 (+ 1184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.182424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.182472 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.182549 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:20.183979 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.184834 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.186401 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.186661 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.186753 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.189622 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:20.189625 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:20.189627 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:20.189657 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:20.191171 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:20.191757 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:20.191760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:20.191761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:20.191849 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:20.192241 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:20.192245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:20.192247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:20.192476 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:20.192599 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.193290 (+ 691us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.193440 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 17:01:20.194734 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.180401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34299 (local address 127.7.153.3:33741)
0806 17:01:20.181051 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.181139 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.182227 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.182716 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.182722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.183186 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:20.183702 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.183716 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.185074 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.185079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.186244 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.186261 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.186824 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.186827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.186991 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.187692 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:20.187712 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:20.189406 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:20.191305 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:20.191311 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:20.191329 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:20.191628 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:20.191939 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:20.191941 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:20.191942 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:20.192115 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:20.192606 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:20.192612 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:20.192974 (+ 362us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.193218 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.193626 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":158,"threads_started":1}
I20260806 17:01:20.195966 26431 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34299
I20260806 17:01:20.196297 26431 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:20.197003 26431 heartbeater.cc:511] Master 127.7.153.62:34299 requested a full tablet report, sending...
I20260806 17:01:20.198436 25937 ts_manager.cc:194] Registered new tserver with Master: 7e932ba0098347cf96c81f45126a8a1f (127.7.153.3:36749)
I20260806 17:01:20.199108 25937 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:33741
I20260806 17:01:20.206660 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:01:20.217237 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.209093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48306 (local address 127.7.153.62:34299)
0806 17:01:20.209246 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.209251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.209415 (+ 164us) server_negotiation.cc:407] Connection header received
0806 17:01:20.209496 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.209499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.209548 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.209638 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:20.210518 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.211135 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.212054 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.212293 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.212401 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.213909 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:20.213912 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:20.213914 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:20.213942 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:20.215466 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:20.215903 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:20.215906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:20.215907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:20.216008 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:20.216266 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:20.216269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:20.216270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:20.216536 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:20.216654 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.216956 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.217083 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 17:01:20.220582 25937 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:01:20.224164 25937 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:01:20.242070 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.234926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:42547 (local address 127.0.0.1:43450)
0806 17:01:20.236746 (+ 1820us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.236761 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.236851 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.237397 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.237400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.237419 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:20.237517 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.237522 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.238705 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.238710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.240003 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.240030 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.241519 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.241523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.241604 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.241685 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.241786 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.241876 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1713,"mutex_wait_us":170,"thread_start_us":96,"threads_started":1}
I20260806 17:01:20.242081 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.235387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46216 (local address 127.7.153.3:36749)
0806 17:01:20.235867 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.235879 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.235905 (+ 26us) server_negotiation.cc:407] Connection header received
0806 17:01:20.235989 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.235995 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.236243 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.236422 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:20.236808 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.238030 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.240024 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.240981 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.241102 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.241391 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.241748 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.241885 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":110,"threads_started":1}
I20260806 17:01:20.242653 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.235702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43450 (local address 127.7.153.1:42547)
0806 17:01:20.236253 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.236261 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.236946 (+ 685us) server_negotiation.cc:407] Connection header received
0806 17:01:20.237029 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.237034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.237244 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.237391 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:20.237644 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.238584 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.240191 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.240981 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.241102 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.241391 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.242402 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.242516 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":158,"threads_started":1}
I20260806 17:01:20.242935 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.234898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42096 (local address 127.7.153.2:44727)
0806 17:01:20.235286 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.235296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.235431 (+ 135us) server_negotiation.cc:407] Connection header received
0806 17:01:20.235667 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.235676 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.236161 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.236858 (+ 697us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:20.237080 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.237955 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.240580 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.242021 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.242150 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.242312 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.242681 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.242787 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":136,"threads_started":1}
I20260806 17:01:20.243273 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.234106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:44727 (local address 127.0.0.1:42096)
0806 17:01:20.234645 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.234700 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.234856 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.236497 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.236501 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.236518 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:20.236645 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.236652 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.238097 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.238110 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.240265 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.240277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.242395 (+ 2118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.242399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.242518 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.242537 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.242639 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.242722 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":388,"thread_start_us":122,"threads_started":1}
I20260806 17:01:20.242084 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.234494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:36749 (local address 127.0.0.1:46216)
0806 17:01:20.234813 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.234827 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.235003 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.236413 (+ 1410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.236420 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.236445 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:20.236616 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.236624 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.238239 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.238242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.239868 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.239882 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.241167 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.241171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.241451 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.241530 (+ 79us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.241687 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.241845 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":235,"thread_start_us":181,"threads_started":1}
I20260806 17:01:20.246415 26217 tablet_service.cc:1467] Processing CreateTablet for tablet 99af640417f54032a1dc90a7c7bb966f (DEFAULT_TABLE table=test-table [id=57b010b176d44245800c808821188d86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:20.246670 26069 tablet_service.cc:1467] Processing CreateTablet for tablet 99af640417f54032a1dc90a7c7bb966f (DEFAULT_TABLE table=test-table [id=57b010b176d44245800c808821188d86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:20.247670 26217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99af640417f54032a1dc90a7c7bb966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:20.247834 26069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99af640417f54032a1dc90a7c7bb966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:20.247404 26360 tablet_service.cc:1467] Processing CreateTablet for tablet 99af640417f54032a1dc90a7c7bb966f (DEFAULT_TABLE table=test-table [id=57b010b176d44245800c808821188d86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:20.248472 26360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99af640417f54032a1dc90a7c7bb966f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:20.255008 26452 tablet_bootstrap.cc:492] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Bootstrap starting.
I20260806 17:01:20.256675 26453 tablet_bootstrap.cc:492] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: Bootstrap starting.
I20260806 17:01:20.256803 26454 tablet_bootstrap.cc:492] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Bootstrap starting.
I20260806 17:01:20.257845 26452 tablet_bootstrap.cc:654] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:20.259130 26454 tablet_bootstrap.cc:654] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:20.259271 26452 log.cc:824] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:20.259406 26453 tablet_bootstrap.cc:654] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:20.260185 26453 log.cc:824] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:20.260484 26454 log.cc:824] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:20.261643 26452 tablet_bootstrap.cc:492] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: No bootstrap required, opened a new log
I20260806 17:01:20.261824 26452 ts_tablet_manager.cc:1397] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 17:01:20.262451 26454 tablet_bootstrap.cc:492] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: No bootstrap required, opened a new log
I20260806 17:01:20.262708 26454 ts_tablet_manager.cc:1397] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 17:01:20.265285 26452 raft_consensus.cc:348] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.265632 26452 raft_consensus.cc:374] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:20.265690 26452 raft_consensus.cc:729] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b8cbe5d3024c2ab6528fdf9ef46289, State: Initialized, Role: FOLLOWER
I20260806 17:01:20.266179 26453 tablet_bootstrap.cc:492] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: No bootstrap required, opened a new log
I20260806 17:01:20.266233 26452 consensus_queue.cc:260] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.266403 26453 ts_tablet_manager.cc:1397] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260806 17:01:20.266602 26454 raft_consensus.cc:348] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.266906 26454 raft_consensus.cc:374] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:20.266987 26454 raft_consensus.cc:729] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e932ba0098347cf96c81f45126a8a1f, State: Initialized, Role: FOLLOWER
I20260806 17:01:20.267087 26285 heartbeater.cc:503] Master 127.7.153.62:34299 was elected leader, sending a full tablet report...
I20260806 17:01:20.267354 26452 ts_tablet_manager.cc:1428] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 17:01:20.267478 26454 consensus_queue.cc:260] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.268205 26431 heartbeater.cc:503] Master 127.7.153.62:34299 was elected leader, sending a full tablet report...
I20260806 17:01:20.268565 26454 ts_tablet_manager.cc:1428] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 17:01:20.273182 26453 raft_consensus.cc:348] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.273473 26453 raft_consensus.cc:374] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:20.273540 26453 raft_consensus.cc:729] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2505e54c910243788a549062d0f6d5ea, State: Initialized, Role: FOLLOWER
I20260806 17:01:20.274019 26453 consensus_queue.cc:260] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.274796 26141 heartbeater.cc:503] Master 127.7.153.62:34299 was elected leader, sending a full tablet report...
I20260806 17:01:20.275214 26453 ts_tablet_manager.cc:1428] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260806 17:01:20.315857 26460 raft_consensus.cc:482] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:20.316162 26460 raft_consensus.cc:504] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.317706 26460 leader_election.cc:288] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8b8cbe5d3024c2ab6528fdf9ef46289 (127.7.153.2:44727), 2505e54c910243788a549062d0f6d5ea (127.7.153.1:42547)
I20260806 17:01:20.322716 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.317973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:44727 (local address 127.7.153.3:34403)
0806 17:01:20.318119 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.318137 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.318239 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.318630 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.318634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.318654 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:20.318803 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.318811 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.319943 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.319947 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.321252 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.321264 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.322244 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.322247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.322360 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.322384 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.322458 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.322550 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 17:01:20.323164 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.318119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:34403 (local address 127.7.153.2:44727)
0806 17:01:20.318274 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.318281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.318304 (+ 23us) server_negotiation.cc:407] Connection header received
0806 17:01:20.318374 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.318378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.318433 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.318558 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:20.318921 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.319837 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.321414 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.321990 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.322111 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.322183 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.322936 (+ 753us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.323015 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 17:01:20.323818 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.318453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:58829 (local address 127.7.153.1:42547)
0806 17:01:20.318597 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.318601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.318739 (+ 138us) server_negotiation.cc:407] Connection header received
0806 17:01:20.318843 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.318846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.318919 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.319020 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:20.319277 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.320055 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.321811 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.322443 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.322539 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.322608 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.323122 (+ 514us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.323593 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 17:01:20.323983 26237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99af640417f54032a1dc90a7c7bb966f" candidate_uuid: "7e932ba0098347cf96c81f45126a8a1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" is_pre_election: true
I20260806 17:01:20.324352 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.318282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:42547 (local address 127.7.153.3:58829)
0806 17:01:20.318643 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.318655 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.318745 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.319032 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.319034 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.319049 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:20.319143 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.319147 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.320224 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.320228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.321655 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.321671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.322646 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.322651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.322828 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.322891 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.324068 (+ 1177us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.324174 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":164,"threads_started":1}
I20260806 17:01:20.324397 26237 raft_consensus.cc:2454] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e932ba0098347cf96c81f45126a8a1f in term 0.
I20260806 17:01:20.325024 26310 leader_election.cc:302] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e932ba0098347cf96c81f45126a8a1f, a8b8cbe5d3024c2ab6528fdf9ef46289; no voters:
I20260806 17:01:20.325361 26090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99af640417f54032a1dc90a7c7bb966f" candidate_uuid: "7e932ba0098347cf96c81f45126a8a1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505e54c910243788a549062d0f6d5ea" is_pre_election: true
I20260806 17:01:20.325403 26460 raft_consensus.cc:2781] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:01:20.325538 26460 raft_consensus.cc:482] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:01:20.325610 26460 raft_consensus.cc:3037] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:20.325696 26090 raft_consensus.cc:2454] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e932ba0098347cf96c81f45126a8a1f in term 0.
I20260806 17:01:20.326958 26460 raft_consensus.cc:504] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.327380 26460 leader_election.cc:288] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [CANDIDATE]: Term 1 election: Requested vote from peers a8b8cbe5d3024c2ab6528fdf9ef46289 (127.7.153.2:44727), 2505e54c910243788a549062d0f6d5ea (127.7.153.1:42547)
I20260806 17:01:20.327898 26237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99af640417f54032a1dc90a7c7bb966f" candidate_uuid: "7e932ba0098347cf96c81f45126a8a1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289"
I20260806 17:01:20.328058 26090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99af640417f54032a1dc90a7c7bb966f" candidate_uuid: "7e932ba0098347cf96c81f45126a8a1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2505e54c910243788a549062d0f6d5ea"
I20260806 17:01:20.328047 26237 raft_consensus.cc:3037] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:20.328233 26090 raft_consensus.cc:3037] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:20.329427 26237 raft_consensus.cc:2454] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e932ba0098347cf96c81f45126a8a1f in term 1.
I20260806 17:01:20.329547 26090 raft_consensus.cc:2454] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e932ba0098347cf96c81f45126a8a1f in term 1.
I20260806 17:01:20.329807 26310 leader_election.cc:302] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e932ba0098347cf96c81f45126a8a1f, a8b8cbe5d3024c2ab6528fdf9ef46289; no voters:
I20260806 17:01:20.330013 26460 raft_consensus.cc:2781] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:20.330281 26460 raft_consensus.cc:686] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 1 LEADER]: Becoming Leader. State: Replica: 7e932ba0098347cf96c81f45126a8a1f, State: Running, Role: LEADER
I20260806 17:01:20.330621 26460 consensus_queue.cc:237] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } }
I20260806 17:01:20.334491 25936 catalog_manager.cc:5495] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e932ba0098347cf96c81f45126a8a1f (127.7.153.3). New cstate: current_term: 1 leader_uuid: "7e932ba0098347cf96c81f45126a8a1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e932ba0098347cf96c81f45126a8a1f" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 36749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 } health_report { overall_health: UNKNOWN } } }
I20260806 17:01:20.348951 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.345165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47426 (local address 127.7.153.3:36749)
0806 17:01:20.345310 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.345315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.345330 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:01:20.345471 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.345474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.345548 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.345671 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:01:20.345925 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.346442 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.347330 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.347558 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.347666 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.348002 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:01:20.348466 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:01:20.348614 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.348676 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.348775 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 17:01:20.355427 26090 raft_consensus.cc:1261] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 1 FOLLOWER]: Refusing update from remote peer 7e932ba0098347cf96c81f45126a8a1f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:20.355459 26237 raft_consensus.cc:1261] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 1 FOLLOWER]: Refusing update from remote peer 7e932ba0098347cf96c81f45126a8a1f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:20.356297 26460 consensus_queue.cc:1035] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b8cbe5d3024c2ab6528fdf9ef46289" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:20.356526 26464 consensus_queue.cc:1035] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2505e54c910243788a549062d0f6d5ea" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 42547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:20.376663 25936 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:20.376869 25936 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:20.379676 25936 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b9556be5f644d74ad59a1fb89d4292f: Sending DeleteTablet for 3 replicas of tablet 99af640417f54032a1dc90a7c7bb966f
I20260806 17:01:20.380764 26360 tablet_service.cc:1514] Processing DeleteTablet for tablet 99af640417f54032a1dc90a7c7bb966f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:46216
I20260806 17:01:20.380959 26217 tablet_service.cc:1514] Processing DeleteTablet for tablet 99af640417f54032a1dc90a7c7bb966f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:42096
I20260806 17:01:20.381131 26069 tablet_service.cc:1514] Processing DeleteTablet for tablet 99af640417f54032a1dc90a7c7bb966f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:20 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:43450
I20260806 17:01:20.381556 26479 tablet_replica.cc:330] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: stopping tablet replica
I20260806 17:01:20.381950 26479 raft_consensus.cc:2229] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:20.382079 26478 tablet_replica.cc:330] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: stopping tablet replica
I20260806 17:01:20.382118 26480 tablet_replica.cc:330] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea: stopping tablet replica
I20260806 17:01:20.382342 26479 raft_consensus.cc:2258] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:20.382402 26478 raft_consensus.cc:2229] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:01:20.382499 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26001
I20260806 17:01:20.382591 26480 raft_consensus.cc:2229] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:20.382920 26480 raft_consensus.cc:2258] T 99af640417f54032a1dc90a7c7bb966f P 2505e54c910243788a549062d0f6d5ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:20.383111 26478 raft_consensus.cc:2258] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:20.384814 26479 ts_tablet_manager.cc:1905] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:20.385037 26478 ts_tablet_manager.cc:1905] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:20.388218 26478 ts_tablet_manager.cc:1918] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:20.388355 26478 log.cc:1196] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/99af640417f54032a1dc90a7c7bb966f
I20260806 17:01:20.388531 26479 ts_tablet_manager.cc:1918] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:20.388650 26479 log.cc:1196] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/99af640417f54032a1dc90a7c7bb966f
I20260806 17:01:20.388947 26478 ts_tablet_manager.cc:1939] T 99af640417f54032a1dc90a7c7bb966f P 7e932ba0098347cf96c81f45126a8a1f: Deleting consensus metadata
I20260806 17:01:20.389041 26479 ts_tablet_manager.cc:1939] T 99af640417f54032a1dc90a7c7bb966f P a8b8cbe5d3024c2ab6528fdf9ef46289: Deleting consensus metadata
I20260806 17:01:20.390487 25922 catalog_manager.cc:4841] TS 7e932ba0098347cf96c81f45126a8a1f (127.7.153.3:36749): tablet 99af640417f54032a1dc90a7c7bb966f (table test-table [id=57b010b176d44245800c808821188d86]) successfully deleted
I20260806 17:01:20.390487 25919 catalog_manager.cc:4841] TS a8b8cbe5d3024c2ab6528fdf9ef46289 (127.7.153.2:44727): tablet 99af640417f54032a1dc90a7c7bb966f (table test-table [id=57b010b176d44245800c808821188d86]) successfully deleted
W20260806 17:01:20.393575 25919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:42547 (error 108)
I20260806 17:01:20.394594 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26146
I20260806 17:01:20.394814 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.394452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:42547 (local address 127.0.0.1:36000)
0806 17:01:20.394617 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.394702 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:42547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 17:01:20.396422 25919 catalog_manager.cc:4584] TS 2505e54c910243788a549062d0f6d5ea (127.7.153.1:42547): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 99af640417f54032a1dc90a7c7bb966f: Network error: Client connection negotiation failed: client connection to 127.7.153.1:42547: connect: Connection refused (error 111)
I20260806 17:01:20.405831 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26291
I20260806 17:01:20.413746 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 25902
2026-08-06T17:01:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2532 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T17:01:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:20Z Disabled control of system clock
I20260806 17:01:20.452000 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44601
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:44601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 17:01:20.577704 26485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:20.578037 26485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:20.578076 26485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:20.582862 26485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:20.582962 26485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:20.582980 26485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:20.582998 26485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:20.583014 26485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:20.588387 26485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:44601
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:20.589843 26485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:20.591425 26485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:20.600817 26491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:20.601178 26485 server_base.cc:1034] running on GCE node
W20260806 17:01:20.600824 26490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:20.600817 26493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:20.601945 26485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:20.603236 26485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:20.604446 26485 hybrid_clock.cc:648] HybridClock initialized: now 1786035680604428 us; error 36 us; skew 500 ppm
I20260806 17:01:20.606772 26485 webserver.cc:460] Webserver started at http://127.7.153.62:40843/ using document root <none> and password file <none>
I20260806 17:01:20.607437 26485 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:20.607540 26485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:20.607798 26485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:20.610313 26485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "2c4b476c4c8a4afb80145513830c96c9"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "80100c549fd919b15adedea238b1447b"
server_key_iv: "b2f2af27c92369aeacdd62c31bccd1fc"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.610965 26485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "2c4b476c4c8a4afb80145513830c96c9"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "80100c549fd919b15adedea238b1447b"
server_key_iv: "b2f2af27c92369aeacdd62c31bccd1fc"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.615996 26485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 17:01:20.619491 26499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.621651 26485 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:20.621858 26485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "2c4b476c4c8a4afb80145513830c96c9"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "80100c549fd919b15adedea238b1447b"
server_key_iv: "b2f2af27c92369aeacdd62c31bccd1fc"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.622026 26485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:20.648031 26485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:20.648923 26485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:20.649147 26485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:20.657038 26485 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:44601
I20260806 17:01:20.657109 26553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:44601 every 8 connection(s)
I20260806 17:01:20.658156 26485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:20.660421 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26485
I20260806 17:01:20.660542 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:20.660903 7780 external_mini_cluster.cc:1428] Setting key aa3a267eb5f3339b70f4f488129b6e51
I20260806 17:01:20.661983 26554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:20.669816 26554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9: Bootstrap starting.
I20260806 17:01:20.672524 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.662412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59996 (local address 127.7.153.62:44601)
0806 17:01:20.663150 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.663174 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.663221 (+ 47us) server_negotiation.cc:407] Connection header received
0806 17:01:20.664161 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.664185 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.664756 (+ 571us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.665144 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:20.665726 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.667260 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.668273 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.669069 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.669250 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.670257 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:20.670264 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:20.670282 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:20.670815 (+ 533us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:20.670893 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:20.670920 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:20.671029 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.671215 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.671533 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":127,"threads_started":1}
I20260806 17:01:20.672883 26554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:20.673697 26554 log.cc:824] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:20.675884 26554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9: No bootstrap required, opened a new log
I20260806 17:01:20.679668 26554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c4b476c4c8a4afb80145513830c96c9" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44601 } }
I20260806 17:01:20.679981 26554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:20.680054 26554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c4b476c4c8a4afb80145513830c96c9, State: Initialized, Role: FOLLOWER
I20260806 17:01:20.680495 26554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c4b476c4c8a4afb80145513830c96c9" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44601 } }
I20260806 17:01:20.680624 26554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:20.680737 26554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:20.680848 26554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:20.681902 26554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c4b476c4c8a4afb80145513830c96c9" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44601 } }
I20260806 17:01:20.682278 26554 leader_election.cc:302] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c4b476c4c8a4afb80145513830c96c9; no voters:
I20260806 17:01:20.682664 26554 leader_election.cc:288] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:20.682834 26560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:20.683115 26560 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [term 1 LEADER]: Becoming Leader. State: Replica: 2c4b476c4c8a4afb80145513830c96c9, State: Running, Role: LEADER
I20260806 17:01:20.683466 26560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c4b476c4c8a4afb80145513830c96c9" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44601 } }
I20260806 17:01:20.684093 26554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:20.685274 26561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c4b476c4c8a4afb80145513830c96c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c4b476c4c8a4afb80145513830c96c9" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44601 } } }
I20260806 17:01:20.685415 26561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:20.685704 26562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c4b476c4c8a4afb80145513830c96c9. Latest consensus state: current_term: 1 leader_uuid: "2c4b476c4c8a4afb80145513830c96c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c4b476c4c8a4afb80145513830c96c9" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44601 } } }
I20260806 17:01:20.685804 26562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:20.685914 26569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:20.689005 26569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:20.695289 26569 catalog_manager.cc:1347] Generated new cluster ID: 47702e0aa00047c681fddb1469f13427
I20260806 17:01:20.695392 26569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:20.717959 26569 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:20.719028 26569 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:20.730571 26569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9: Generated new TSK 0
I20260806 17:01:20.731411 26569 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:20.739184 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44601
--builtin_ntp_servers=127.7.153.20:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 17:01:20.868790 26581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:20.869107 26581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:20.869146 26581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:20.873428 26581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:20.873507 26581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:20.873566 26581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:20.878862 26581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:20.880151 26581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:20.881705 26581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:20.892381 26589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:20.892388 26586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:20.892381 26587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:20.892758 26581 server_base.cc:1034] running on GCE node
I20260806 17:01:20.893270 26581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:20.894093 26581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:20.895296 26581 hybrid_clock.cc:648] HybridClock initialized: now 1786035680895281 us; error 29 us; skew 500 ppm
I20260806 17:01:20.897508 26581 webserver.cc:460] Webserver started at http://127.7.153.1:38873/ using document root <none> and password file <none>
I20260806 17:01:20.898176 26581 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:20.898275 26581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:20.898527 26581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:20.901006 26581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "00c62ed0abb608b1b64b7af8cc8f441b"
server_key_iv: "1a3f9122d9d845c4f9db138423df5140"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.901769 26581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "00c62ed0abb608b1b64b7af8cc8f441b"
server_key_iv: "1a3f9122d9d845c4f9db138423df5140"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.906070 26581 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260806 17:01:20.909001 26597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.910396 26581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 17:01:20.910557 26581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8"
format_stamp: "Formatted at 2026-08-06 17:01:20 on dist-test-slave-cbsf"
server_key: "00c62ed0abb608b1b64b7af8cc8f441b"
server_key_iv: "1a3f9122d9d845c4f9db138423df5140"
server_key_version: "encryptionkey@0"
I20260806 17:01:20.910704 26581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:20.931077 26581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:20.931960 26581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:20.932199 26581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:20.932951 26581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:20.934020 26581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:20.934096 26581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.934168 26581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:20.934221 26581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:20.943984 26581 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:41365
I20260806 17:01:20.944010 26716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:41365 every 8 connection(s)
I20260806 17:01:20.945145 26581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:20.948074 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26581
I20260806 17:01:20.948228 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:01:20.948586 7780 external_mini_cluster.cc:1428] Setting key 2aec04fa819c229b9c6150d2e6a56e31
I20260806 17:01:20.951094 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44601
--builtin_ntp_servers=127.7.153.20:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 17:01:20.957116 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.947412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:36903 (local address 127.7.153.62:44601)
0806 17:01:20.947575 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:20.947579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:20.949033 (+ 1454us) server_negotiation.cc:407] Connection header received
0806 17:01:20.950811 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:20.950814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:20.950871 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:20.950960 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:20.952296 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.952999 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.954491 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.954767 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.954902 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.956272 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:20.956281 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:20.956284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:20.956298 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:20.956327 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:20.956335 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:20.956418 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:20.956760 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 17:01:20.956891 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 17:01:20.958361 26719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:20.947866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44601 (local address 127.7.153.1:36903)
0806 17:01:20.948809 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:20.948871 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:20.950528 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:20.951195 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:20.951209 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:20.951337 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:20.952116 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.952138 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.953171 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.953174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.954312 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:20.954346 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:20.954962 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:20.954967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:20.955177 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:20.955943 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:20.955945 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:20.955995 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:20.956080 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:20.956435 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:20.956445 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:20.956452 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 17:01:20.956720 (+ 268us) client_negotiation.cc:240] Negotiation successful
0806 17:01:20.957075 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":173,"threads_started":1}
I20260806 17:01:20.959960 26717 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44601
I20260806 17:01:20.960240 26717 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:20.960935 26717 heartbeater.cc:511] Master 127.7.153.62:44601 requested a full tablet report, sending...
I20260806 17:01:20.962646 26516 ts_manager.cc:194] Registered new tserver with Master: 355d2e8ee5f64bcfb4ad8eb2801620f8 (127.7.153.1:41365)
I20260806 17:01:20.963924 26516 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.1:36903
W20260806 17:01:21.080785 26720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:21.081164 26720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:21.081240 26720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:21.085882 26720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:21.085987 26720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:21.086086 26720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:21.091537 26720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:21.092891 26720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:21.094450 26720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:21.105626 26728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:21.105626 26725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:21.105746 26720 server_base.cc:1034] running on GCE node
W20260806 17:01:21.105657 26726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:21.106472 26720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:21.107264 26720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:21.108500 26720 hybrid_clock.cc:648] HybridClock initialized: now 1786035681108479 us; error 37 us; skew 500 ppm
I20260806 17:01:21.110867 26720 webserver.cc:460] Webserver started at http://127.7.153.2:38761/ using document root <none> and password file <none>
I20260806 17:01:21.111599 26720 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:21.111850 26720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:21.112145 26720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:21.114948 26720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "8aab657cdc2f459da829898e587f2e72"
format_stamp: "Formatted at 2026-08-06 17:01:21 on dist-test-slave-cbsf"
server_key: "9f9243696f40ce20f755a902d22ec850"
server_key_iv: "dcdc0aa6bb1c1943a7503949d96072e7"
server_key_version: "encryptionkey@0"
I20260806 17:01:21.115690 26720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "8aab657cdc2f459da829898e587f2e72"
format_stamp: "Formatted at 2026-08-06 17:01:21 on dist-test-slave-cbsf"
server_key: "9f9243696f40ce20f755a902d22ec850"
server_key_iv: "dcdc0aa6bb1c1943a7503949d96072e7"
server_key_version: "encryptionkey@0"
I20260806 17:01:21.120846 26720 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 17:01:21.123811 26734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:21.125569 26720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:21.125766 26720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "8aab657cdc2f459da829898e587f2e72"
format_stamp: "Formatted at 2026-08-06 17:01:21 on dist-test-slave-cbsf"
server_key: "9f9243696f40ce20f755a902d22ec850"
server_key_iv: "dcdc0aa6bb1c1943a7503949d96072e7"
server_key_version: "encryptionkey@0"
I20260806 17:01:21.125968 26720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:21.182359 26720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:21.183190 26720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:21.183424 26720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:21.184103 26720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:21.185340 26720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:21.185413 26720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:21.185487 26720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:21.185525 26720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:21.195854 26720 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:40661
I20260806 17:01:21.195880 26858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:40661 every 8 connection(s)
I20260806 17:01:21.197070 26720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:01:21.201560 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26720
I20260806 17:01:21.201668 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:01:21.201973 7780 external_mini_cluster.cc:1428] Setting key b5b86943456ae40add7f8328f804e27a
I20260806 17:01:21.204180 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44601
--builtin_ntp_servers=127.7.153.20:42527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 17:01:21.208673 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.199163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:47857 (local address 127.7.153.62:44601)
0806 17:01:21.199320 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.199324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.200510 (+ 1186us) server_negotiation.cc:407] Connection header received
0806 17:01:21.202194 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.202197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.202264 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.202389 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:21.203589 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.204164 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.206129 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.206537 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.206681 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.208004 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:21.208011 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:21.208017 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:21.208038 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:21.208066 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:21.208079 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:21.208167 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.208328 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.208421 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 17:01:21.209575 26862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.199594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44601 (local address 127.7.153.2:47857)
0806 17:01:21.200321 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.200368 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.201892 (+ 1524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.202594 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.202602 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.202699 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:21.203433 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.203452 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.204319 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.204326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.205943 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.205971 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.206731 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.206734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.206912 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.207685 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:21.207686 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:21.207733 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:21.207815 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:21.208173 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:21.208181 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:21.208186 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.208299 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.208564 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":123,"threads_started":1}
I20260806 17:01:21.211112 26859 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44601
I20260806 17:01:21.211398 26859 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:21.212020 26859 heartbeater.cc:511] Master 127.7.153.62:44601 requested a full tablet report, sending...
I20260806 17:01:21.213528 26516 ts_manager.cc:194] Registered new tserver with Master: 8aab657cdc2f459da829898e587f2e72 (127.7.153.2:40661)
I20260806 17:01:21.214232 26516 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.2:47857
W20260806 17:01:21.331858 26863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:21.332224 26863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:21.332319 26863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:21.337174 26863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:21.337292 26863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:21.337389 26863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:21.343094 26863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:42527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:44601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:21.344416 26863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:21.346105 26863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:21.356966 26870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:21.356980 26869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:21.357055 26872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:21.357214 26863 server_base.cc:1034] running on GCE node
I20260806 17:01:21.357752 26863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:21.358582 26863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:21.361999 26863 hybrid_clock.cc:648] HybridClock initialized: now 1786035681361992 us; error 245 us; skew 500 ppm
I20260806 17:01:21.364538 26863 webserver.cc:460] Webserver started at http://127.7.153.3:35693/ using document root <none> and password file <none>
I20260806 17:01:21.365319 26863 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:21.365437 26863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:21.365720 26863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:21.368039 26863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "d847da9f6cf9406da7f381b5e2a22fdf"
format_stamp: "Formatted at 2026-08-06 17:01:21 on dist-test-slave-cbsf"
server_key: "b6cf1043cebd8d4d6a6a40b556362d90"
server_key_iv: "e29cd05631726e0899399ad1d006fbaa"
server_key_version: "encryptionkey@0"
I20260806 17:01:21.368777 26863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "d847da9f6cf9406da7f381b5e2a22fdf"
format_stamp: "Formatted at 2026-08-06 17:01:21 on dist-test-slave-cbsf"
server_key: "b6cf1043cebd8d4d6a6a40b556362d90"
server_key_iv: "e29cd05631726e0899399ad1d006fbaa"
server_key_version: "encryptionkey@0"
I20260806 17:01:21.373142 26863 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 17:01:21.376991 26878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:21.379153 26863 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:21.379357 26863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "d847da9f6cf9406da7f381b5e2a22fdf"
format_stamp: "Formatted at 2026-08-06 17:01:21 on dist-test-slave-cbsf"
server_key: "b6cf1043cebd8d4d6a6a40b556362d90"
server_key_iv: "e29cd05631726e0899399ad1d006fbaa"
server_key_version: "encryptionkey@0"
I20260806 17:01:21.379571 26863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:21.400833 26863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:21.401593 26863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:21.401765 26863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:21.402379 26863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:21.403400 26863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:21.403450 26863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:21.403493 26863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:21.403508 26863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:21.413733 26863 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:46231
I20260806 17:01:21.413780 27004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:46231 every 8 connection(s)
I20260806 17:01:21.414832 26863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:21.424041 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 26863
I20260806 17:01:21.424216 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:01:21.424592 7780 external_mini_cluster.cc:1428] Setting key 9ce53a69e497a76740406a9f7c1c07ba
I20260806 17:01:21.426538 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.417062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:50837 (local address 127.7.153.62:44601)
0806 17:01:21.417265 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.417270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.418567 (+ 1297us) server_negotiation.cc:407] Connection header received
0806 17:01:21.420082 (+ 1515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.420085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.420152 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.420239 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:21.421471 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.422051 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.423549 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.423805 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.423909 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.425955 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:21.425958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:21.425960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:21.425974 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:21.425997 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:21.426005 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:21.426098 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.426305 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.426389 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 17:01:21.427769 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.417570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:44601 (local address 127.7.153.3:50837)
0806 17:01:21.418384 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.418435 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.419809 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.420493 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.420501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.420602 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:21.421290 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.421307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.422236 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.422240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.423390 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.423402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.424031 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.424035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.424315 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.425439 (+ 1124us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:21.425440 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:21.425537 (+ 97us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:21.425679 (+ 142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:21.426102 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:21.426115 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:21.426125 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.426300 (+ 175us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.426701 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":141,"threads_started":1}
I20260806 17:01:21.429101 27005 heartbeater.cc:347] Connected to a master server at 127.7.153.62:44601
I20260806 17:01:21.429386 27005 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:21.430128 27005 heartbeater.cc:511] Master 127.7.153.62:44601 requested a full tablet report, sending...
I20260806 17:01:21.431422 26516 ts_manager.cc:194] Registered new tserver with Master: d847da9f6cf9406da7f381b5e2a22fdf (127.7.153.3:46231)
I20260806 17:01:21.432055 26516 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.3:50837
I20260806 17:01:21.440305 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:01:21.447261 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.442929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60000 (local address 127.7.153.62:44601)
0806 17:01:21.443126 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.443131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.443276 (+ 145us) server_negotiation.cc:407] Connection header received
0806 17:01:21.443454 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.443465 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.443543 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.443640 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:21.443970 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.444510 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.445491 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.445729 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.445854 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.446794 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:21.446800 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:21.446809 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:21.446822 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:21.446842 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:21.446850 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:21.446932 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.447026 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.447094 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 17:01:21.451153 26516 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:01:21.454572 26516 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:01:21.472404 27020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.466065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39514 (local address 127.7.153.1:41365)
0806 17:01:21.466859 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.466867 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.466893 (+ 26us) server_negotiation.cc:407] Connection header received
0806 17:01:21.466979 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.466984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.467214 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.467809 (+ 595us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:21.467950 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.469040 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.470940 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.471645 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.471795 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.472041 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.472115 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.472239 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":73,"threads_started":1}
I20260806 17:01:21.472411 27019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.465879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46231 (local address 127.0.0.1:43990)
0806 17:01:21.466328 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.466393 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.466549 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.468060 (+ 1511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.468063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.468083 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:21.468186 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.468193 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.469629 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.469633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.470815 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.470822 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.471991 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.472007 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.472103 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.472127 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.472180 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.472282 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":116,"thread_start_us":99,"threads_started":1}
I20260806 17:01:21.472800 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.466775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:40661 (local address 127.0.0.1:54384)
0806 17:01:21.467255 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.467270 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.467360 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.467912 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.467917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.467935 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:21.468060 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.468067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.469672 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.469675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.470996 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.471007 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.472310 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.472314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.472399 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.472421 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.472495 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.472610 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":197,"thread_start_us":110,"threads_started":1}
I20260806 17:01:21.473031 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.465879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:41365 (local address 127.0.0.1:39514)
0806 17:01:21.466441 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.466455 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.466549 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.467407 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.467415 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.467443 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:21.467622 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.467630 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.469172 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.469177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.470783 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.470796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.471793 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.471796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.471917 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.471956 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.472078 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.472884 (+ 806us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"mutex_wait_us":395,"thread_start_us":92,"threads_started":1}
I20260806 17:01:21.473376 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.466971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54384 (local address 127.7.153.2:40661)
0806 17:01:21.467396 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.467408 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.467430 (+ 22us) server_negotiation.cc:407] Connection header received
0806 17:01:21.467500 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.467504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.467680 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.467815 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:21.468196 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.469492 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.471137 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.471958 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.472058 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.472250 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.473085 (+ 835us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.473215 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":111,"threads_started":1}
I20260806 17:01:21.474248 27023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.466797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.7.153.3:46231)
0806 17:01:21.467601 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.467613 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.467636 (+ 23us) server_negotiation.cc:407] Connection header received
0806 17:01:21.467718 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.467723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.467906 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.468060 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:21.468334 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.469500 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.470969 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.471821 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.472284 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.472464 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.473085 (+ 621us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.474071 (+ 986us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":164,"threads_started":1}
I20260806 17:01:21.476608 26932 tablet_service.cc:1467] Processing CreateTablet for tablet babc2fe995d24d63a969197c267bc4d7 (DEFAULT_TABLE table=test-table [id=21c93586104645629861a1c3b56fa67d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:21.476550 26788 tablet_service.cc:1467] Processing CreateTablet for tablet babc2fe995d24d63a969197c267bc4d7 (DEFAULT_TABLE table=test-table [id=21c93586104645629861a1c3b56fa67d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:21.476552 26648 tablet_service.cc:1467] Processing CreateTablet for tablet babc2fe995d24d63a969197c267bc4d7 (DEFAULT_TABLE table=test-table [id=21c93586104645629861a1c3b56fa67d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:21.477762 26932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet babc2fe995d24d63a969197c267bc4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:21.477769 26648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet babc2fe995d24d63a969197c267bc4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:21.477769 26788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet babc2fe995d24d63a969197c267bc4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:21.485164 27025 tablet_bootstrap.cc:492] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Bootstrap starting.
I20260806 17:01:21.486372 27027 tablet_bootstrap.cc:492] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: Bootstrap starting.
I20260806 17:01:21.487974 27025 tablet_bootstrap.cc:654] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:21.488176 27027 tablet_bootstrap.cc:654] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:21.488819 27026 tablet_bootstrap.cc:492] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Bootstrap starting.
I20260806 17:01:21.488976 27025 log.cc:824] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:21.489010 27027 log.cc:824] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:21.491307 27025 tablet_bootstrap.cc:492] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: No bootstrap required, opened a new log
I20260806 17:01:21.491376 27027 tablet_bootstrap.cc:492] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: No bootstrap required, opened a new log
I20260806 17:01:21.491364 27026 tablet_bootstrap.cc:654] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:21.491552 27025 ts_tablet_manager.cc:1397] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 17:01:21.491565 27027 ts_tablet_manager.cc:1397] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 17:01:21.492272 27026 log.cc:824] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:21.495393 27026 tablet_bootstrap.cc:492] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: No bootstrap required, opened a new log
I20260806 17:01:21.495651 27026 ts_tablet_manager.cc:1397] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20260806 17:01:21.495451 27025 raft_consensus.cc:348] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.495829 27025 raft_consensus.cc:374] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:21.495896 27025 raft_consensus.cc:729] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d847da9f6cf9406da7f381b5e2a22fdf, State: Initialized, Role: FOLLOWER
I20260806 17:01:21.496415 27025 consensus_queue.cc:260] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.496977 27027 raft_consensus.cc:348] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.497298 27027 raft_consensus.cc:374] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:21.497362 27027 raft_consensus.cc:729] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 355d2e8ee5f64bcfb4ad8eb2801620f8, State: Initialized, Role: FOLLOWER
I20260806 17:01:21.497555 27025 ts_tablet_manager.cc:1428] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260806 17:01:21.497828 27027 consensus_queue.cc:260] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.498001 27005 heartbeater.cc:503] Master 127.7.153.62:44601 was elected leader, sending a full tablet report...
I20260806 17:01:21.498584 26717 heartbeater.cc:503] Master 127.7.153.62:44601 was elected leader, sending a full tablet report...
I20260806 17:01:21.498894 27027 ts_tablet_manager.cc:1428] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 17:01:21.500180 27026 raft_consensus.cc:348] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.500439 27026 raft_consensus.cc:374] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:21.500524 27026 raft_consensus.cc:729] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aab657cdc2f459da829898e587f2e72, State: Initialized, Role: FOLLOWER
I20260806 17:01:21.501055 27026 consensus_queue.cc:260] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.502040 26859 heartbeater.cc:503] Master 127.7.153.62:44601 was elected leader, sending a full tablet report...
I20260806 17:01:21.502182 27026 ts_tablet_manager.cc:1428] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260806 17:01:21.527441 27033 raft_consensus.cc:482] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:21.527712 27033 raft_consensus.cc:504] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.529065 27033 leader_election.cc:288] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 355d2e8ee5f64bcfb4ad8eb2801620f8 (127.7.153.1:41365), d847da9f6cf9406da7f381b5e2a22fdf (127.7.153.3:46231)
I20260806 17:01:21.533432 27023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.529551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:37393 (local address 127.7.153.3:46231)
0806 17:01:21.529693 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.529697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.529900 (+ 203us) server_negotiation.cc:407] Connection header received
0806 17:01:21.530034 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.530037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.530085 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.530168 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:21.530563 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.531244 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.532350 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.532805 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.532936 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.533001 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.533244 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.533323 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 17:01:21.533418 27020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.529457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:35329 (local address 127.7.153.1:41365)
0806 17:01:21.529592 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.529596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.529739 (+ 143us) server_negotiation.cc:407] Connection header received
0806 17:01:21.529846 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.529852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.529913 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.529992 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:21.530429 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.531033 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.532262 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.532792 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.532912 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.532988 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.533185 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.533271 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 17:01:21.533420 26862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.529292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:41365 (local address 127.7.153.2:35329)
0806 17:01:21.529582 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.529607 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.529729 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.530021 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.530024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.530044 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:21.530253 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.530264 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.531157 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.531161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.532110 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.532121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.532925 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.532929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.533046 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.533068 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.533147 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.533255 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":21}
I20260806 17:01:21.533428 27034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.529431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:46231 (local address 127.7.153.2:37393)
0806 17:01:21.529790 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.529805 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:21.529913 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:21.530223 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:21.530226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:21.530246 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:21.530412 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.530420 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.531360 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.531363 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.532211 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:21.532225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.532976 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.532980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:21.533083 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.533107 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 17:01:21.533208 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 17:01:21.533274 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":20,"thread_start_us":174,"threads_started":1}
I20260806 17:01:21.534297 26953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "babc2fe995d24d63a969197c267bc4d7" candidate_uuid: "8aab657cdc2f459da829898e587f2e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" is_pre_election: true
I20260806 17:01:21.534287 26670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "babc2fe995d24d63a969197c267bc4d7" candidate_uuid: "8aab657cdc2f459da829898e587f2e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" is_pre_election: true
I20260806 17:01:21.534649 26670 raft_consensus.cc:2454] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aab657cdc2f459da829898e587f2e72 in term 0.
I20260806 17:01:21.534670 26953 raft_consensus.cc:2454] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aab657cdc2f459da829898e587f2e72 in term 0.
I20260806 17:01:21.535332 26740 leader_election.cc:302] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 355d2e8ee5f64bcfb4ad8eb2801620f8, 8aab657cdc2f459da829898e587f2e72, d847da9f6cf9406da7f381b5e2a22fdf; no voters:
I20260806 17:01:21.535696 27033 raft_consensus.cc:2781] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:01:21.535815 27033 raft_consensus.cc:482] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:01:21.535874 27033 raft_consensus.cc:3037] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:21.537020 27033 raft_consensus.cc:504] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.537449 27033 leader_election.cc:288] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [CANDIDATE]: Term 1 election: Requested vote from peers 355d2e8ee5f64bcfb4ad8eb2801620f8 (127.7.153.1:41365), d847da9f6cf9406da7f381b5e2a22fdf (127.7.153.3:46231)
I20260806 17:01:21.537935 26670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "babc2fe995d24d63a969197c267bc4d7" candidate_uuid: "8aab657cdc2f459da829898e587f2e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8"
I20260806 17:01:21.538014 26953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "babc2fe995d24d63a969197c267bc4d7" candidate_uuid: "8aab657cdc2f459da829898e587f2e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d847da9f6cf9406da7f381b5e2a22fdf"
I20260806 17:01:21.538098 26670 raft_consensus.cc:3037] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:21.538172 26953 raft_consensus.cc:3037] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:21.539279 26670 raft_consensus.cc:2454] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aab657cdc2f459da829898e587f2e72 in term 1.
I20260806 17:01:21.539281 26953 raft_consensus.cc:2454] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aab657cdc2f459da829898e587f2e72 in term 1.
I20260806 17:01:21.539703 26740 leader_election.cc:302] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 355d2e8ee5f64bcfb4ad8eb2801620f8, 8aab657cdc2f459da829898e587f2e72; no voters:
I20260806 17:01:21.539968 27033 raft_consensus.cc:2781] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:21.540187 27033 raft_consensus.cc:686] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 1 LEADER]: Becoming Leader. State: Replica: 8aab657cdc2f459da829898e587f2e72, State: Running, Role: LEADER
I20260806 17:01:21.540614 27033 consensus_queue.cc:237] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } }
I20260806 17:01:21.544420 26515 catalog_manager.cc:5495] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aab657cdc2f459da829898e587f2e72 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "8aab657cdc2f459da829898e587f2e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aab657cdc2f459da829898e587f2e72" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 40661 } health_report { overall_health: HEALTHY } } }
I20260806 17:01:21.560678 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.557203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54390 (local address 127.7.153.2:40661)
0806 17:01:21.557344 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:21.557347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:21.557361 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:01:21.557497 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:21.557499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:21.557560 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:21.557673 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:01:21.557883 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.558385 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.559207 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:21.559434 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:21.559517 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:21.559793 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:01:21.560271 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:01:21.560369 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:21.560465 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 17:01:21.560520 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 17:01:21.567466 26670 raft_consensus.cc:1261] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 1 FOLLOWER]: Refusing update from remote peer 8aab657cdc2f459da829898e587f2e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:21.567467 26953 raft_consensus.cc:1261] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 1 FOLLOWER]: Refusing update from remote peer 8aab657cdc2f459da829898e587f2e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:21.568348 27035 consensus_queue.cc:1035] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "355d2e8ee5f64bcfb4ad8eb2801620f8" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 41365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:21.568567 27033 consensus_queue.cc:1035] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d847da9f6cf9406da7f381b5e2a22fdf" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 46231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:21.578469 27040 mvcc.cc:205] Tried to move back new op lower bound from 7315602151691837440 to 7315602151594086400. Current Snapshot: MvccSnapshot[applied={T|T < 7315602151691837440}]
I20260806 17:01:21.588629 26515 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:21.588862 26515 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:21.591615 26515 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c4b476c4c8a4afb80145513830c96c9: Sending DeleteTablet for 3 replicas of tablet babc2fe995d24d63a969197c267bc4d7
I20260806 17:01:21.592651 26788 tablet_service.cc:1514] Processing DeleteTablet for tablet babc2fe995d24d63a969197c267bc4d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:21 UTC) from {username='slave'} at 127.0.0.1:54384
I20260806 17:01:21.592651 26932 tablet_service.cc:1514] Processing DeleteTablet for tablet babc2fe995d24d63a969197c267bc4d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:21 UTC) from {username='slave'} at 127.0.0.1:43990
I20260806 17:01:21.593317 27050 tablet_replica.cc:330] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: stopping tablet replica
I20260806 17:01:21.593300 26648 tablet_service.cc:1514] Processing DeleteTablet for tablet babc2fe995d24d63a969197c267bc4d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:21 UTC) from {username='slave'} at 127.0.0.1:39514
I20260806 17:01:21.593777 27051 tablet_replica.cc:330] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8: stopping tablet replica
I20260806 17:01:21.593823 27050 raft_consensus.cc:2229] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:01:21.594074 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26581
I20260806 17:01:21.594095 27051 raft_consensus.cc:2229] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:21.594480 27051 raft_consensus.cc:2258] T babc2fe995d24d63a969197c267bc4d7 P 355d2e8ee5f64bcfb4ad8eb2801620f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:21.594511 27050 raft_consensus.cc:2258] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:21.595052 27049 tablet_replica.cc:330] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: stopping tablet replica
I20260806 17:01:21.595435 27049 raft_consensus.cc:2229] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:21.595836 27049 raft_consensus.cc:2258] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:21.597213 27050 ts_tablet_manager.cc:1905] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:21.597606 27049 ts_tablet_manager.cc:1905] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:21.600561 27049 ts_tablet_manager.cc:1918] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:21.600795 27049 log.cc:1196] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/babc2fe995d24d63a969197c267bc4d7
I20260806 17:01:21.601006 27050 ts_tablet_manager.cc:1918] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:21.601125 27050 log.cc:1196] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/babc2fe995d24d63a969197c267bc4d7
I20260806 17:01:21.601336 27049 ts_tablet_manager.cc:1939] T babc2fe995d24d63a969197c267bc4d7 P d847da9f6cf9406da7f381b5e2a22fdf: Deleting consensus metadata
I20260806 17:01:21.601466 27050 ts_tablet_manager.cc:1939] T babc2fe995d24d63a969197c267bc4d7 P 8aab657cdc2f459da829898e587f2e72: Deleting consensus metadata
I20260806 17:01:21.602872 26502 catalog_manager.cc:4841] TS d847da9f6cf9406da7f381b5e2a22fdf (127.7.153.3:46231): tablet babc2fe995d24d63a969197c267bc4d7 (table test-table [id=21c93586104645629861a1c3b56fa67d]) successfully deleted
I20260806 17:01:21.602972 26503 catalog_manager.cc:4841] TS 8aab657cdc2f459da829898e587f2e72 (127.7.153.2:40661): tablet babc2fe995d24d63a969197c267bc4d7 (table test-table [id=21c93586104645629861a1c3b56fa67d]) successfully deleted
W20260806 17:01:21.607592 26503 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:41365 (error 108)
I20260806 17:01:21.607810 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26720
I20260806 17:01:21.610488 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:21.610000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:41365 (local address 127.0.0.1:39518)
0806 17:01:21.610331 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:21.610402 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246}
W20260806 17:01:21.610672 26503 catalog_manager.cc:4584] TS 355d2e8ee5f64bcfb4ad8eb2801620f8 (127.7.153.1:41365): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet babc2fe995d24d63a969197c267bc4d7: Network error: Client connection negotiation failed: client connection to 127.7.153.1:41365: connect: Connection refused (error 111)
I20260806 17:01:21.617317 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26863
I20260806 17:01:21.625711 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 26485
2026-08-06T17:01:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1210 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:21 dist-test-slave-cbsf krb5kdc[27055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:21 dist-test-slave-cbsf krb5kdc[27055](info): set up 2 sockets
Aug 06 17:01:21 dist-test-slave-cbsf krb5kdc[27055](info): commencing operation
krb5kdc: starting...
W20260806 17:01:22.740315 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:22 dist-test-slave-cbsf krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:22.883589 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34835
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:23.009443 27068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:23.009776 27068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:23.009847 27068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:23.014269 27068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:23.014356 27068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:23.014377 27068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:23.014395 27068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:23.014411 27068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:23.020869 27068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:23.022181 27068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:23.023324 27068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:23.033018 27077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.032998 27074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.033002 27075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:23.033353 27068 server_base.cc:1034] running on GCE node
I20260806 17:01:23.034046 27068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:23.035368 27068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:23.038727 27068 hybrid_clock.cc:648] HybridClock initialized: now 1786035683038687 us; error 65 us; skew 500 ppm
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:23.047387 27068 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:23.048589 27068 webserver.cc:460] Webserver started at http://127.7.153.62:37347/ using document root <none> and password file <none>
I20260806 17:01:23.049296 27068 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:23.049376 27068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:23.049566 27068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:23.051785 27068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "e8a2807843e04ed49658b68f62b62cd3"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "d2a0a7fdcc89a75fb82465fc99410db3"
server_key_iv: "9a04dc1bbdeabd4d5d5e3ddc6800f64e"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.052371 27068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "e8a2807843e04ed49658b68f62b62cd3"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "d2a0a7fdcc89a75fb82465fc99410db3"
server_key_iv: "9a04dc1bbdeabd4d5d5e3ddc6800f64e"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.058789 27068 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260806 17:01:23.062541 27086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.064342 27068 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 17:01:23.064548 27068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "e8a2807843e04ed49658b68f62b62cd3"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "d2a0a7fdcc89a75fb82465fc99410db3"
server_key_iv: "9a04dc1bbdeabd4d5d5e3ddc6800f64e"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.064752 27068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:23.116101 27068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:23.119730 27068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:23.119978 27068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:23.128211 27068 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34835
I20260806 17:01:23.128237 27142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34835 every 8 connection(s)
I20260806 17:01:23.129334 27068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:23.132575 27143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:23.133719 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27068
I20260806 17:01:23.133869 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:23.134213 7780 external_mini_cluster.cc:1428] Setting key f88a8dd7e6a38d75920e4fd6b36b2799
I20260806 17:01:23.139878 27143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3: Bootstrap starting.
I20260806 17:01:23.142601 27143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:23.143487 27143 log.cc:824] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3: Log is configured to *not* fsync() on all Append() calls
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:23.146188 27143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3: No bootstrap required, opened a new log
I20260806 17:01:23.150163 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.136018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.7.153.62:34835)
0806 17:01:23.136575 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.136591 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.136639 (+ 48us) server_negotiation.cc:407] Connection header received
0806 17:01:23.137494 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.137514 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.137877 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.138231 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:23.139139 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.140214 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.141212 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.141710 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.141884 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.144899 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:23.144905 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:23.144921 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:23.144950 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:23.146830 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.147331 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.147337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.147342 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.147461 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.147764 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.147768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.147770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.148234 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:23.148448 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.148951 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.149297 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":154,"threads_started":1}
I20260806 17:01:23.150460 27143 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a2807843e04ed49658b68f62b62cd3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34835 } }
I20260806 17:01:23.150802 27143 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:23.150867 27143 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a2807843e04ed49658b68f62b62cd3, State: Initialized, Role: FOLLOWER
I20260806 17:01:23.151368 27143 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a2807843e04ed49658b68f62b62cd3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34835 } }
I20260806 17:01:23.151595 27143 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:23.151667 27143 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:23.151796 27143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:23.153077 27143 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a2807843e04ed49658b68f62b62cd3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34835 } }
I20260806 17:01:23.153452 27143 leader_election.cc:302] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8a2807843e04ed49658b68f62b62cd3; no voters:
I20260806 17:01:23.153863 27143 leader_election.cc:288] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:23.154086 27148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:23.154341 27148 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [term 1 LEADER]: Becoming Leader. State: Replica: e8a2807843e04ed49658b68f62b62cd3, State: Running, Role: LEADER
I20260806 17:01:23.154666 27148 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a2807843e04ed49658b68f62b62cd3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34835 } }
I20260806 17:01:23.155289 27143 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:23.156409 27149 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8a2807843e04ed49658b68f62b62cd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a2807843e04ed49658b68f62b62cd3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34835 } } }
I20260806 17:01:23.156549 27149 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:23.156807 27151 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8a2807843e04ed49658b68f62b62cd3. Latest consensus state: current_term: 1 leader_uuid: "e8a2807843e04ed49658b68f62b62cd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a2807843e04ed49658b68f62b62cd3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34835 } } }
I20260806 17:01:23.156922 27151 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:23.157986 27158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:23.161418 27158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:23.167373 27158 catalog_manager.cc:1347] Generated new cluster ID: 071d0b71a477494b893c51ee92471fed
I20260806 17:01:23.167469 27158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:23.196357 27158 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:23.197539 27158 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:23.205314 27158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3: Generated new TSK 0
I20260806 17:01:23.206113 27158 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 17:01:23.246066 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34835
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:23.368490 27171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:23.368927 27171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:23.369015 27171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:23.373379 27171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:23.373500 27171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:23.373602 27171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:23.379256 27171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:23.380551 27171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:23.381728 27171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:23.392165 27180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.392197 27177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.392194 27178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:23.392371 27171 server_base.cc:1034] running on GCE node
I20260806 17:01:23.392978 27171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:23.393685 27171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:23.394886 27171 hybrid_clock.cc:648] HybridClock initialized: now 1786035683394873 us; error 29 us; skew 500 ppm
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:23.398051 27171 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:01:23.399055 27171 webserver.cc:460] Webserver started at http://127.7.153.1:39087/ using document root <none> and password file <none>
I20260806 17:01:23.399629 27171 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:23.399691 27171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:23.399871 27171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:23.402045 27171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "e53c853be223450a97f5bd2ea2122b78"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "b830c2efe99285975616a17332fc486d"
server_key_iv: "8d2039983924dc55dcb9423d086de08b"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.402592 27171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "e53c853be223450a97f5bd2ea2122b78"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "b830c2efe99285975616a17332fc486d"
server_key_iv: "8d2039983924dc55dcb9423d086de08b"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.406726 27171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:23.409436 27188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.410769 27171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:23.410918 27171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "e53c853be223450a97f5bd2ea2122b78"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "b830c2efe99285975616a17332fc486d"
server_key_iv: "8d2039983924dc55dcb9423d086de08b"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.411048 27171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:23.422405 27171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:23.425882 27171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:23.426124 27171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:23.426810 27171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:23.427737 27171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:23.427784 27171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.427827 27171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:23.427884 27171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.440234 27171 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:46235
I20260806 17:01:23.440255 27311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:46235 every 8 connection(s)
I20260806 17:01:23.441529 27171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:23.445009 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27171
I20260806 17:01:23.445185 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:01:23.445568 7780 external_mini_cluster.cc:1428] Setting key 921ae8c5c3b8afbd7c3c8b5918d66247
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 17:01:23.460558 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.444274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:44457 (local address 127.7.153.62:34835)
0806 17:01:23.444507 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.444514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.446026 (+ 1512us) server_negotiation.cc:407] Connection header received
0806 17:01:23.447122 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.447126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.447202 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.447300 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:23.449319 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.449925 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.451795 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.452264 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.452403 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.455696 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:23.455701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:23.455704 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:23.455745 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:23.457897 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.458632 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.458635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.458636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.458736 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.459159 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.459162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.459164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.459463 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:23.459588 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.460234 (+ 646us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.460387 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 17:01:23.461690 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.444789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34835 (local address 127.7.153.1:44457)
0806 17:01:23.445786 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:23.445852 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:23.446830 (+ 978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:23.447605 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:23.447616 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:23.448235 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:23.449107 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.449133 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.450094 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.450101 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.451649 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.451662 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.452467 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.452470 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.452670 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.453469 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:23.453488 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:23.455435 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:23.458104 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:23.458111 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:23.458133 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:23.458465 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:23.458844 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:23.458848 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:23.458850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:23.459032 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:23.459615 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:23.459622 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:23.459948 (+ 326us) client_negotiation.cc:769] Sending connection context
0806 17:01:23.460132 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 17:01:23.460446 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":161,"threads_started":1}
I20260806 17:01:23.463289 27312 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34835
I20260806 17:01:23.463589 27312 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:23.464198 27312 heartbeater.cc:511] Master 127.7.153.62:34835 requested a full tablet report, sending...
I20260806 17:01:23.466336 27104 ts_manager.cc:194] Registered new tserver with Master: e53c853be223450a97f5bd2ea2122b78 (127.7.153.1:46235)
I20260806 17:01:23.468176 27104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:44457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 17:01:23.481725 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34835
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:23.607100 27318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:23.607419 27318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:23.607466 27318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:23.611703 27318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:23.611794 27318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:23.611860 27318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:23.617661 27318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:23.618865 27318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:23.619916 27318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:23.630019 27327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.630031 27323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.630024 27324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:23.630239 27318 server_base.cc:1034] running on GCE node
I20260806 17:01:23.630961 27318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:23.631680 27318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:23.632831 27318 hybrid_clock.cc:648] HybridClock initialized: now 1786035683632796 us; error 52 us; skew 500 ppm
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:23.635939 27318 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:01:23.637079 27318 webserver.cc:460] Webserver started at http://127.7.153.2:46475/ using document root <none> and password file <none>
I20260806 17:01:23.637743 27318 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:23.637843 27318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:23.638104 27318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:23.640395 27318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "74141e0aa3934ef6becd12969766ee42"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "36f5ae4e62dd491cf49c5bf313d24e46"
server_key_iv: "72ca452e2aad3ce7362e990221af39e9"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.641052 27318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "74141e0aa3934ef6becd12969766ee42"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "36f5ae4e62dd491cf49c5bf313d24e46"
server_key_iv: "72ca452e2aad3ce7362e990221af39e9"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.645293 27318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:23.648167 27335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.649833 27318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:23.650004 27318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "74141e0aa3934ef6becd12969766ee42"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "36f5ae4e62dd491cf49c5bf313d24e46"
server_key_iv: "72ca452e2aad3ce7362e990221af39e9"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.650272 27318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:23.663829 27318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:23.667954 27318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:23.668150 27318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:23.668864 27318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:23.669818 27318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:23.669888 27318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.669936 27318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:23.669955 27318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.679615 27318 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:38247
I20260806 17:01:23.679631 27458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:38247 every 8 connection(s)
I20260806 17:01:23.680675 27318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:23.690971 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27318
I20260806 17:01:23.691155 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:01:23.691462 7780 external_mini_cluster.cc:1428] Setting key 1cdf846448f76336deb671d939f8646c
I20260806 17:01:23.695729 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.682886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:50209 (local address 127.7.153.62:34835)
0806 17:01:23.683033 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.683037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.684193 (+ 1156us) server_negotiation.cc:407] Connection header received
0806 17:01:23.685123 (+ 930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.685126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.685177 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.685261 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:23.686652 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.687213 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.688444 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.688667 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.688840 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.691663 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:23.691667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:23.691669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:23.691697 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:23.693386 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.693975 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.693979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.693988 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.694074 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.694449 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.694452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.694454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.694660 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:23.694767 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.695471 (+ 704us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.695585 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 17:01:23.697006 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.683303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34835 (local address 127.7.153.2:50209)
0806 17:01:23.684019 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:23.684075 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:23.684890 (+ 815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:23.685494 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:23.685503 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:23.685942 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:23.686472 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.686487 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.687345 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.687348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.688287 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.688297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.688888 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.688891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.689083 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.689715 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:23.689732 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:23.691445 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:23.693531 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:23.693539 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:23.693564 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:23.693864 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:23.694172 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:23.694176 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:23.694178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:23.694333 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:23.694783 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:23.694792 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:23.695140 (+ 348us) client_negotiation.cc:769] Sending connection context
0806 17:01:23.695400 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 17:01:23.695831 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":122,"threads_started":1}
I20260806 17:01:23.698458 27459 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34835
I20260806 17:01:23.698747 27459 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:23.699302 27459 heartbeater.cc:511] Master 127.7.153.62:34835 requested a full tablet report, sending...
I20260806 17:01:23.700503 27104 ts_manager.cc:194] Registered new tserver with Master: 74141e0aa3934ef6becd12969766ee42 (127.7.153.2:38247)
I20260806 17:01:23.701150 27104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:50209
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 17:01:23.724114 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34835
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:23.849828 27464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:23.850198 27464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:23.850284 27464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:23.854745 27464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:23.854854 27464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:23.854960 27464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:23.861016 27464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:34835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:23.862365 27464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:23.863519 27464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:23.875138 27470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.875142 27473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:23.875166 27471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:23.875402 27464 server_base.cc:1034] running on GCE node
I20260806 17:01:23.875933 27464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:23.876796 27464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:23.878016 27464 hybrid_clock.cc:648] HybridClock initialized: now 1786035683877995 us; error 38 us; skew 500 ppm
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:23.881474 27464 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:01:23.882627 27464 webserver.cc:460] Webserver started at http://127.7.153.3:43457/ using document root <none> and password file <none>
I20260806 17:01:23.883296 27464 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:23.883397 27464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:23.883659 27464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:23.886013 27464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "0b39eaf0286d4bafb56464a9ab6fdc44"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "939282197a22524b4d2e75ea8995cf78"
server_key_iv: "ff2944f9cf5f2493c849606d086cd2a5"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.886662 27464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "0b39eaf0286d4bafb56464a9ab6fdc44"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "939282197a22524b4d2e75ea8995cf78"
server_key_iv: "ff2944f9cf5f2493c849606d086cd2a5"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.891041 27464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:23.894207 27480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.895743 27464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 17:01:23.895931 27464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "0b39eaf0286d4bafb56464a9ab6fdc44"
format_stamp: "Formatted at 2026-08-06 17:01:23 on dist-test-slave-cbsf"
server_key: "939282197a22524b4d2e75ea8995cf78"
server_key_iv: "ff2944f9cf5f2493c849606d086cd2a5"
server_key_version: "encryptionkey@0"
I20260806 17:01:23.896076 27464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:23.914268 27464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:23.918205 27464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:23.918445 27464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:23.919126 27464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:23.920079 27464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:23.920158 27464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.920233 27464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:23.920285 27464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:23.930161 27464 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:39159
I20260806 17:01:23.930181 27603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:39159 every 8 connection(s)
I20260806 17:01:23.931206 27464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:23.933048 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27464
I20260806 17:01:23.933204 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:01:23.933552 7780 external_mini_cluster.cc:1428] Setting key b9b8a8335008786167045fc0a3bfe552
Aug 06 17:01:23 dist-test-slave-cbsf krb5kdc[27055](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035683, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:23.946432 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.933678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:42661 (local address 127.7.153.62:34835)
0806 17:01:23.934007 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.934012 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.934827 (+ 815us) server_negotiation.cc:407] Connection header received
0806 17:01:23.935908 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.935911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.935969 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.936060 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:23.937426 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.937984 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.939285 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.939512 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.939627 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.942551 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:23.942555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:23.942557 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:23.942611 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:23.944177 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.944861 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.944865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.944866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.944955 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.945311 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.945314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.945315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.945517 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:23.945598 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.946180 (+ 582us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.946299 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
I20260806 17:01:23.947767 27606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.933988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34835 (local address 127.7.153.3:42661)
0806 17:01:23.934650 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:23.934713 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:23.935660 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:23.936244 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:23.936252 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:23.936671 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:23.937278 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.937293 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.938140 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.938143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.939135 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.939145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.939700 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.939703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.939859 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.940495 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:23.940514 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:23.942316 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:23.944324 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:23.944330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:23.944348 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:23.944665 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:23.945053 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:23.945055 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:23.945057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:23.945220 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:23.945611 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:23.945617 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:23.945932 (+ 315us) client_negotiation.cc:769] Sending connection context
0806 17:01:23.946110 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 17:01:23.946514 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":174,"threads_started":1}
I20260806 17:01:23.949015 27604 heartbeater.cc:347] Connected to a master server at 127.7.153.62:34835
I20260806 17:01:23.949277 27604 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:23.949842 27604 heartbeater.cc:511] Master 127.7.153.62:34835 requested a full tablet report, sending...
I20260806 17:01:23.950989 27104 ts_manager.cc:194] Registered new tserver with Master: 0b39eaf0286d4bafb56464a9ab6fdc44 (127.7.153.3:39159)
I20260806 17:01:23.951622 27104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:42661
I20260806 17:01:23.960578 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:01:23.972014 27146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.963005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49888 (local address 127.7.153.62:34835)
0806 17:01:23.963146 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.963150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.963345 (+ 195us) server_negotiation.cc:407] Connection header received
0806 17:01:23.963421 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.963423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.963472 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.963539 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:23.964368 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.965003 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.965898 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.966148 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.966238 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.968126 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:23.968131 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:23.968134 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:23.968281 (+ 147us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:23.969942 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.970602 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.970606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.970608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.970700 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:23.971004 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:23.971006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:23.971007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:23.971247 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:23.971400 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.971786 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.971877 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 17:01:23.976213 27104 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:01:23.979682 27104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:01:23.996570 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.990325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.7.153.2:38247)
0806 17:01:23.991551 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.991563 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.991588 (+ 25us) server_negotiation.cc:407] Connection header received
0806 17:01:23.991673 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.991679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.991918 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.992098 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:23.992411 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.993337 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.995102 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.995786 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.995927 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.996099 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.996290 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.996389 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1130,"thread_start_us":100,"threads_started":1}
I20260806 17:01:23.996564 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.990077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:38247 (local address 127.0.0.1:51618)
0806 17:01:23.990994 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:23.991053 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:23.991192 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:23.992084 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:23.992090 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:23.992113 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:23.992287 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.992294 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.993477 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.993483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.994956 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.994967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.995927 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.995931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.996054 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.996094 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 17:01:23.996244 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 17:01:23.996390 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"mutex_wait_us":112,"thread_start_us":223,"threads_started":1}
I20260806 17:01:23.996914 27620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.990876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:39159 (local address 127.0.0.1:47738)
0806 17:01:23.991691 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:23.991704 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:23.991799 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:23.992348 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:23.992353 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:23.992373 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:23.992477 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.992484 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.993902 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.993905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.995143 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.995154 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.996475 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.996478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.996553 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.996593 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 17:01:23.996664 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 17:01:23.996775 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":73,"thread_start_us":95,"threads_started":1}
I20260806 17:01:23.997184 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.990129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46235 (local address 127.0.0.1:45460)
0806 17:01:23.991150 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:23.991164 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:23.991367 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:23.992164 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:23.992167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:23.992185 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:23.992350 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.992359 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.993851 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.993856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.995181 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:23.995189 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.996295 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.996299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:23.996397 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.996421 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 17:01:23.996476 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 17:01:23.996547 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":133,"thread_start_us":87,"threads_started":1}
I20260806 17:01:23.997669 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.991128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.7.153.3:39159)
0806 17:01:23.991533 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.991548 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.991808 (+ 260us) server_negotiation.cc:407] Connection header received
0806 17:01:23.991886 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.991890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.992046 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.992190 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:23.992616 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.993763 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.995289 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.996150 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.996270 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.996413 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.997381 (+ 968us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.997505 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":104,"threads_started":1}
I20260806 17:01:23.997711 27619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:23.990494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45460 (local address 127.7.153.1:46235)
0806 17:01:23.991660 (+ 1166us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:23.991669 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:23.991693 (+ 24us) server_negotiation.cc:407] Connection header received
0806 17:01:23.991797 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:23.991802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:23.991990 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:23.992247 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:23.992456 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.993694 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.995349 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:23.996154 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:23.996867 (+ 713us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:23.997027 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:23.997103 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 17:01:23.997568 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1054,"thread_start_us":114,"threads_started":1}
I20260806 17:01:24.000500 27239 tablet_service.cc:1467] Processing CreateTablet for tablet 6974a956fda44507a1ef1ddbd7c93600 (DEFAULT_TABLE table=test-table [id=0a54fc129ac1423abf2fcf2a61557e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:24.000474 27529 tablet_service.cc:1467] Processing CreateTablet for tablet 6974a956fda44507a1ef1ddbd7c93600 (DEFAULT_TABLE table=test-table [id=0a54fc129ac1423abf2fcf2a61557e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:24.000471 27387 tablet_service.cc:1467] Processing CreateTablet for tablet 6974a956fda44507a1ef1ddbd7c93600 (DEFAULT_TABLE table=test-table [id=0a54fc129ac1423abf2fcf2a61557e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:24.001794 27529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6974a956fda44507a1ef1ddbd7c93600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:24.001794 27387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6974a956fda44507a1ef1ddbd7c93600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:24.001796 27239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6974a956fda44507a1ef1ddbd7c93600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:24.008980 27622 tablet_bootstrap.cc:492] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: Bootstrap starting.
I20260806 17:01:24.010301 27623 tablet_bootstrap.cc:492] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Bootstrap starting.
I20260806 17:01:24.010565 27624 tablet_bootstrap.cc:492] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Bootstrap starting.
I20260806 17:01:24.011723 27622 tablet_bootstrap.cc:654] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:24.012217 27623 tablet_bootstrap.cc:654] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:24.012737 27622 log.cc:824] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:24.013135 27624 tablet_bootstrap.cc:654] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:24.013434 27623 log.cc:824] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:24.013943 27624 log.cc:824] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:24.015515 27623 tablet_bootstrap.cc:492] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: No bootstrap required, opened a new log
I20260806 17:01:24.015584 27622 tablet_bootstrap.cc:492] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: No bootstrap required, opened a new log
I20260806 17:01:24.015795 27622 ts_tablet_manager.cc:1397] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 17:01:24.015797 27623 ts_tablet_manager.cc:1397] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 17:01:24.016115 27624 tablet_bootstrap.cc:492] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: No bootstrap required, opened a new log
I20260806 17:01:24.016294 27624 ts_tablet_manager.cc:1397] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 17:01:24.019035 27623 raft_consensus.cc:348] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.019342 27623 raft_consensus.cc:374] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:24.019404 27623 raft_consensus.cc:729] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b39eaf0286d4bafb56464a9ab6fdc44, State: Initialized, Role: FOLLOWER
I20260806 17:01:24.019897 27623 consensus_queue.cc:260] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.020406 27624 raft_consensus.cc:348] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.020498 27622 raft_consensus.cc:348] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.020740 27624 raft_consensus.cc:374] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:24.020754 27622 raft_consensus.cc:374] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:24.020810 27622 raft_consensus.cc:729] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e53c853be223450a97f5bd2ea2122b78, State: Initialized, Role: FOLLOWER
I20260806 17:01:24.020821 27624 raft_consensus.cc:729] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74141e0aa3934ef6becd12969766ee42, State: Initialized, Role: FOLLOWER
I20260806 17:01:24.021169 27623 ts_tablet_manager.cc:1428] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260806 17:01:24.021332 27624 consensus_queue.cc:260] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.021332 27622 consensus_queue.cc:260] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.021574 27604 heartbeater.cc:503] Master 127.7.153.62:34835 was elected leader, sending a full tablet report...
I20260806 17:01:24.022368 27622 ts_tablet_manager.cc:1428] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 17:01:24.022368 27624 ts_tablet_manager.cc:1428] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 17:01:24.022715 27312 heartbeater.cc:503] Master 127.7.153.62:34835 was elected leader, sending a full tablet report...
I20260806 17:01:24.022715 27459 heartbeater.cc:503] Master 127.7.153.62:34835 was elected leader, sending a full tablet report...
W20260806 17:01:24.182190 27460 tablet.cc:2369] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 17:01:24.182417 27605 tablet.cc:2369] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 17:01:24.193112 27313 tablet.cc:2369] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 17:01:24.298430 27628 raft_consensus.cc:482] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:24.298751 27628 raft_consensus.cc:504] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.300230 27628 leader_election.cc:288] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74141e0aa3934ef6becd12969766ee42 (127.7.153.2:38247), e53c853be223450a97f5bd2ea2122b78 (127.7.153.1:46235)
I20260806 17:01:24.305732 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.300736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:34709 (local address 127.7.153.2:38247)
0806 17:01:24.300859 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:24.300867 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:24.300913 (+ 46us) server_negotiation.cc:407] Connection header received
0806 17:01:24.301155 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:24.301158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:24.301214 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:24.301287 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:24.301653 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.302475 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.304270 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.304954 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.305073 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.305147 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:24.305501 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 17:01:24.305585 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 17:01:24.305732 27619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.300770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:36925 (local address 127.7.153.1:46235)
0806 17:01:24.300928 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:24.300933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:24.301354 (+ 421us) server_negotiation.cc:407] Connection header received
0806 17:01:24.301470 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:24.301472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:24.301513 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:24.301575 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:24.301862 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.302576 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.304270 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.304963 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.305073 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.305147 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:24.305501 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 17:01:24.305585 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 17:01:24.305757 27606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.300569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:38247 (local address 127.7.153.3:34709)
0806 17:01:24.300826 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:24.300845 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:24.300983 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:24.301330 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:24.301333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:24.301369 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:24.301516 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:24.301522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.302600 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.302602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:24.304094 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:24.304107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.305115 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.305119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:24.305334 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.305380 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 17:01:24.305462 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 17:01:24.305587 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":180,"spinlock_wait_cycles":1408}
I20260806 17:01:24.305766 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.300606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46235 (local address 127.7.153.3:36925)
0806 17:01:24.301229 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:24.301240 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:24.301361 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:24.301617 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:24.301620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:24.301640 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:24.301749 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:24.301754 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.302696 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.302699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:24.304094 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:24.304107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.305115 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.305119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:24.305329 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.305376 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 17:01:24.305462 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 17:01:24.305584 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":336,"spinlock_wait_cycles":1792,"thread_start_us":158,"threads_started":1}
I20260806 17:01:24.306691 27261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6974a956fda44507a1ef1ddbd7c93600" candidate_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e53c853be223450a97f5bd2ea2122b78" is_pre_election: true
I20260806 17:01:24.306691 27408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6974a956fda44507a1ef1ddbd7c93600" candidate_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74141e0aa3934ef6becd12969766ee42" is_pre_election: true
I20260806 17:01:24.307067 27261 raft_consensus.cc:2454] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b39eaf0286d4bafb56464a9ab6fdc44 in term 0.
I20260806 17:01:24.307067 27408 raft_consensus.cc:2454] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b39eaf0286d4bafb56464a9ab6fdc44 in term 0.
I20260806 17:01:24.307701 27483 leader_election.cc:302] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b39eaf0286d4bafb56464a9ab6fdc44, 74141e0aa3934ef6becd12969766ee42, e53c853be223450a97f5bd2ea2122b78; no voters:
I20260806 17:01:24.307994 27628 raft_consensus.cc:2781] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:01:24.308084 27628 raft_consensus.cc:482] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:01:24.308127 27628 raft_consensus.cc:3037] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:24.309342 27628 raft_consensus.cc:504] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.309731 27628 leader_election.cc:288] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [CANDIDATE]: Term 1 election: Requested vote from peers 74141e0aa3934ef6becd12969766ee42 (127.7.153.2:38247), e53c853be223450a97f5bd2ea2122b78 (127.7.153.1:46235)
I20260806 17:01:24.310217 27408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6974a956fda44507a1ef1ddbd7c93600" candidate_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74141e0aa3934ef6becd12969766ee42"
I20260806 17:01:24.310250 27261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6974a956fda44507a1ef1ddbd7c93600" candidate_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e53c853be223450a97f5bd2ea2122b78"
I20260806 17:01:24.310374 27408 raft_consensus.cc:3037] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:24.310415 27261 raft_consensus.cc:3037] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:24.311496 27408 raft_consensus.cc:2454] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b39eaf0286d4bafb56464a9ab6fdc44 in term 1.
I20260806 17:01:24.311678 27261 raft_consensus.cc:2454] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b39eaf0286d4bafb56464a9ab6fdc44 in term 1.
I20260806 17:01:24.311940 27481 leader_election.cc:302] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b39eaf0286d4bafb56464a9ab6fdc44, 74141e0aa3934ef6becd12969766ee42; no voters:
I20260806 17:01:24.312135 27628 raft_consensus.cc:2781] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:24.312397 27628 raft_consensus.cc:686] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 1 LEADER]: Becoming Leader. State: Replica: 0b39eaf0286d4bafb56464a9ab6fdc44, State: Running, Role: LEADER
I20260806 17:01:24.312860 27628 consensus_queue.cc:237] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } }
I20260806 17:01:24.316475 27102 catalog_manager.cc:5495] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b39eaf0286d4bafb56464a9ab6fdc44 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b39eaf0286d4bafb56464a9ab6fdc44" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260806 17:01:24.368153 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.364552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47740 (local address 127.7.153.3:39159)
0806 17:01:24.364730 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:24.364733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:24.364795 (+ 62us) server_negotiation.cc:407] Connection header received
0806 17:01:24.364883 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:24.364885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:24.364946 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:24.365036 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:01:24.365281 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.365830 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.366675 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.366895 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.366985 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.367269 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:01:24.367738 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:01:24.367855 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:24.367982 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 17:01:24.368025 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 17:01:24.375212 27261 raft_consensus.cc:1261] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78 [term 1 FOLLOWER]: Refusing update from remote peer 0b39eaf0286d4bafb56464a9ab6fdc44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:24.375209 27408 raft_consensus.cc:1261] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 1 FOLLOWER]: Refusing update from remote peer 0b39eaf0286d4bafb56464a9ab6fdc44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:24.376044 27632 consensus_queue.cc:1035] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e53c853be223450a97f5bd2ea2122b78" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 46235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:24.376260 27628 consensus_queue.cc:1035] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74141e0aa3934ef6becd12969766ee42" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:24.383849 27635 mvcc.cc:205] Tried to move back new op lower bound from 7315602163192524800 to 7315602162948276224. Current Snapshot: MvccSnapshot[applied={T|T < 7315602163192524800}]
I20260806 17:01:24.384325 27638 mvcc.cc:205] Tried to move back new op lower bound from 7315602163192524800 to 7315602162948276224. Current Snapshot: MvccSnapshot[applied={T|T < 7315602163192524800}]
I20260806 17:01:24.395622 27104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:24.395852 27104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:24.398775 27104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8a2807843e04ed49658b68f62b62cd3: Sending DeleteTablet for 3 replicas of tablet 6974a956fda44507a1ef1ddbd7c93600
I20260806 17:01:24.399893 27239 tablet_service.cc:1514] Processing DeleteTablet for tablet 6974a956fda44507a1ef1ddbd7c93600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:24 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:45460
I20260806 17:01:24.399945 27387 tablet_service.cc:1514] Processing DeleteTablet for tablet 6974a956fda44507a1ef1ddbd7c93600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:24 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:51618
I20260806 17:01:24.399878 27529 tablet_service.cc:1514] Processing DeleteTablet for tablet 6974a956fda44507a1ef1ddbd7c93600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:24 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:47738
I20260806 17:01:24.400472 27648 tablet_replica.cc:330] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: stopping tablet replica
I20260806 17:01:24.400751 27649 tablet_replica.cc:330] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: stopping tablet replica
I20260806 17:01:24.400993 27650 tablet_replica.cc:330] T 6974a956fda44507a1ef1ddbd7c93600 P e53c853be223450a97f5bd2ea2122b78: stopping tablet replica
I20260806 17:01:24.401146 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27171
I20260806 17:01:24.402813 27648 raft_consensus.cc:2229] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:01:24.403167 27649 raft_consensus.cc:2229] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:24.403352 27648 raft_consensus.cc:2258] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:24.403672 27649 raft_consensus.cc:2258] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:24.405617 27648 ts_tablet_manager.cc:1905] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:24.405743 27649 ts_tablet_manager.cc:1905] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:24.408816 27649 ts_tablet_manager.cc:1918] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:24.408946 27649 log.cc:1196] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/6974a956fda44507a1ef1ddbd7c93600
I20260806 17:01:24.409292 27649 ts_tablet_manager.cc:1939] T 6974a956fda44507a1ef1ddbd7c93600 P 74141e0aa3934ef6becd12969766ee42: Deleting consensus metadata
I20260806 17:01:24.409432 27648 ts_tablet_manager.cc:1918] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:24.409548 27648 log.cc:1196] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/6974a956fda44507a1ef1ddbd7c93600
I20260806 17:01:24.409914 27648 ts_tablet_manager.cc:1939] T 6974a956fda44507a1ef1ddbd7c93600 P 0b39eaf0286d4bafb56464a9ab6fdc44: Deleting consensus metadata
I20260806 17:01:24.410889 27087 catalog_manager.cc:4841] TS 74141e0aa3934ef6becd12969766ee42 (127.7.153.2:38247): tablet 6974a956fda44507a1ef1ddbd7c93600 (table test-table [id=0a54fc129ac1423abf2fcf2a61557e11]) successfully deleted
I20260806 17:01:24.411252 27087 catalog_manager.cc:4841] TS 0b39eaf0286d4bafb56464a9ab6fdc44 (127.7.153.3:39159): tablet 6974a956fda44507a1ef1ddbd7c93600 (table test-table [id=0a54fc129ac1423abf2fcf2a61557e11]) successfully deleted
W20260806 17:01:24.412139 27090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:46235 (error 108)
I20260806 17:01:24.413084 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27318
I20260806 17:01:24.413318 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.412986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:46235 (local address 127.0.0.1:45472)
0806 17:01:24.413131 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:24.413215 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:46235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 17:01:24.417119 27090 catalog_manager.cc:4584] TS e53c853be223450a97f5bd2ea2122b78 (127.7.153.1:46235): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6974a956fda44507a1ef1ddbd7c93600: Network error: Client connection negotiation failed: client connection to 127.7.153.1:46235: connect: Connection refused (error 111)
I20260806 17:01:24.427271 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27464
I20260806 17:01:24.435089 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27068
2026-08-06T17:01:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2809 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T17:01:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:24Z Disabled control of system clock
I20260806 17:01:24.472093 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41361
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:46695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:41361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 17:01:24.593180 27655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:24.593515 27655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:24.593556 27655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:24.597772 27655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:24.597854 27655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:24.597869 27655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:24.597887 27655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:24.597903 27655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:24.603171 27655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:41361
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:41361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:24.604420 27655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:24.605978 27655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:24.615455 27663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:24.615451 27661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:24.615451 27660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:24.615784 27655 server_base.cc:1034] running on GCE node
I20260806 17:01:24.616492 27655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:24.617926 27655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:24.619169 27655 hybrid_clock.cc:648] HybridClock initialized: now 1786035684619138 us; error 49 us; skew 500 ppm
I20260806 17:01:24.621456 27655 webserver.cc:460] Webserver started at http://127.7.153.62:33279/ using document root <none> and password file <none>
I20260806 17:01:24.622133 27655 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:24.622241 27655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:24.622499 27655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:24.624853 27655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "fe782ef7787e48f6b7c4e9918bf71c09"
format_stamp: "Formatted at 2026-08-06 17:01:24 on dist-test-slave-cbsf"
server_key: "148b0d8a2276e0b989874c6bb90fdcc4"
server_key_iv: "be84c8d4f3ba95781ca3fd08ccf057a6"
server_key_version: "encryptionkey@0"
I20260806 17:01:24.625470 27655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "fe782ef7787e48f6b7c4e9918bf71c09"
format_stamp: "Formatted at 2026-08-06 17:01:24 on dist-test-slave-cbsf"
server_key: "148b0d8a2276e0b989874c6bb90fdcc4"
server_key_iv: "be84c8d4f3ba95781ca3fd08ccf057a6"
server_key_version: "encryptionkey@0"
I20260806 17:01:24.629594 27655 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:24.632335 27670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:24.633989 27655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:24.634176 27655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "fe782ef7787e48f6b7c4e9918bf71c09"
format_stamp: "Formatted at 2026-08-06 17:01:24 on dist-test-slave-cbsf"
server_key: "148b0d8a2276e0b989874c6bb90fdcc4"
server_key_iv: "be84c8d4f3ba95781ca3fd08ccf057a6"
server_key_version: "encryptionkey@0"
I20260806 17:01:24.634317 27655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:24.668248 27655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:24.669106 27655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:24.669338 27655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:24.677037 27655 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:41361
I20260806 17:01:24.677054 27725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:41361 every 8 connection(s)
I20260806 17:01:24.678121 27655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:24.680755 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27655
I20260806 17:01:24.680882 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:24.681241 7780 external_mini_cluster.cc:1428] Setting key 3ea127a0085cca93a3ad66419325f6ee
I20260806 17:01:24.681988 27726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:24.689339 27726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09: Bootstrap starting.
I20260806 17:01:24.691928 27726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:24.692549 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.682910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.7.153.62:41361)
0806 17:01:24.684139 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:24.684165 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:24.684231 (+ 66us) server_negotiation.cc:407] Connection header received
0806 17:01:24.685224 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:24.685248 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:24.685728 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:24.686125 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:24.686619 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.687776 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.688820 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.689337 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.689542 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.690530 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:24.690535 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:24.690549 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:24.690971 (+ 422us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:24.691033 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:24.691055 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:24.691175 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:24.691298 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 17:01:24.691610 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":197,"threads_started":1}
I20260806 17:01:24.692910 27726 log.cc:824] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:24.695278 27726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09: No bootstrap required, opened a new log
I20260806 17:01:24.699314 27726 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41361 } }
I20260806 17:01:24.699637 27726 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:24.699726 27726 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe782ef7787e48f6b7c4e9918bf71c09, State: Initialized, Role: FOLLOWER
I20260806 17:01:24.700213 27726 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41361 } }
I20260806 17:01:24.700388 27726 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:24.700452 27726 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:24.700568 27726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:24.701797 27726 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41361 } }
I20260806 17:01:24.702208 27726 leader_election.cc:302] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe782ef7787e48f6b7c4e9918bf71c09; no voters:
I20260806 17:01:24.702603 27726 leader_election.cc:288] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:24.702737 27731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:24.702999 27731 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [term 1 LEADER]: Becoming Leader. State: Replica: fe782ef7787e48f6b7c4e9918bf71c09, State: Running, Role: LEADER
I20260806 17:01:24.703366 27731 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41361 } }
I20260806 17:01:24.704145 27726 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:24.705407 27733 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe782ef7787e48f6b7c4e9918bf71c09. Latest consensus state: current_term: 1 leader_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41361 } } }
I20260806 17:01:24.705407 27732 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe782ef7787e48f6b7c4e9918bf71c09" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 41361 } } }
I20260806 17:01:24.705567 27732 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:24.705569 27733 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:24.706034 27740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:24.709151 27740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:24.715189 27740 catalog_manager.cc:1347] Generated new cluster ID: 94896a03aba84d0ba9082f8dd9d42538
I20260806 17:01:24.715297 27740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:24.726577 27740 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:24.728055 27740 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:24.748415 27740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09: Generated new TSK 0
I20260806 17:01:24.749318 27740 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:24.763373 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41361
--builtin_ntp_servers=127.7.153.20:46695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 17:01:24.896885 27752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:24.897226 27752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:24.897271 27752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:24.901644 27752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:24.901721 27752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:24.901782 27752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:24.906973 27752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:24.908172 27752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:24.909659 27752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:24.920359 27760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:24.920475 27752 server_base.cc:1034] running on GCE node
W20260806 17:01:24.920395 27757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:24.920395 27758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:24.921387 27752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:24.922355 27752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:24.923744 27752 hybrid_clock.cc:648] HybridClock initialized: now 1786035684923663 us; error 90 us; skew 500 ppm
I20260806 17:01:24.926085 27752 webserver.cc:460] Webserver started at http://127.7.153.1:40431/ using document root <none> and password file <none>
I20260806 17:01:24.926764 27752 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:24.926872 27752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:24.927135 27752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:24.929481 27752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "6e84f64800644e8ba52e163359405948"
format_stamp: "Formatted at 2026-08-06 17:01:24 on dist-test-slave-cbsf"
server_key: "f4fdbd5f0438a24319a6b16bc765e1f3"
server_key_iv: "1251661d8e1b5318ee83b7c1d2a0dc29"
server_key_version: "encryptionkey@0"
I20260806 17:01:24.930106 27752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "6e84f64800644e8ba52e163359405948"
format_stamp: "Formatted at 2026-08-06 17:01:24 on dist-test-slave-cbsf"
server_key: "f4fdbd5f0438a24319a6b16bc765e1f3"
server_key_iv: "1251661d8e1b5318ee83b7c1d2a0dc29"
server_key_version: "encryptionkey@0"
I20260806 17:01:24.934815 27752 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:24.939091 27767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:24.941056 27752 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 17:01:24.941263 27752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "6e84f64800644e8ba52e163359405948"
format_stamp: "Formatted at 2026-08-06 17:01:24 on dist-test-slave-cbsf"
server_key: "f4fdbd5f0438a24319a6b16bc765e1f3"
server_key_iv: "1251661d8e1b5318ee83b7c1d2a0dc29"
server_key_version: "encryptionkey@0"
I20260806 17:01:24.941431 27752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:24.955159 27752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:24.955999 27752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:24.956235 27752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:24.956991 27752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:24.958076 27752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:24.958156 27752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:24.958231 27752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:24.958276 27752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:24.969753 27752 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:39047
I20260806 17:01:24.969820 27892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:39047 every 8 connection(s)
I20260806 17:01:24.970845 27752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:24.972471 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27752
I20260806 17:01:24.972631 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:01:24.973011 7780 external_mini_cluster.cc:1428] Setting key ded797752e128869338c9b41ed4fcbd9
I20260806 17:01:24.975339 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41361
--builtin_ntp_servers=127.7.153.20:46695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 17:01:24.983678 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.973279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:44929 (local address 127.7.153.62:41361)
0806 17:01:24.973454 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:24.973460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:24.974955 (+ 1495us) server_negotiation.cc:407] Connection header received
0806 17:01:24.976664 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:24.976668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:24.976754 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:24.976879 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:24.978351 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.978922 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.981107 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.981337 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.981438 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.983097 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:24.983100 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:24.983102 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:24.983118 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:24.983140 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:24.983148 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:24.983213 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:24.983446 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 17:01:24.983532 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 17:01:24.985270 27896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:24.973805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41361 (local address 127.7.153.1:44929)
0806 17:01:24.974753 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:24.974822 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:24.976412 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:24.977094 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:24.977106 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:24.977280 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:24.978138 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:24.978163 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.979090 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.979097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:24.980945 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:24.980965 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:24.981548 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:24.981555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:24.981863 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:24.982673 (+ 810us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:24.982678 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:24.982755 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:24.982880 (+ 125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:24.983253 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:24.983268 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:24.983277 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 17:01:24.983454 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 17:01:24.983878 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":140,"threads_started":1}
I20260806 17:01:24.986855 27893 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41361
I20260806 17:01:24.987175 27893 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:24.988021 27893 heartbeater.cc:511] Master 127.7.153.62:41361 requested a full tablet report, sending...
I20260806 17:01:24.990017 27688 ts_manager.cc:194] Registered new tserver with Master: 6e84f64800644e8ba52e163359405948 (127.7.153.1:39047)
I20260806 17:01:24.991472 27688 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.1:44929
W20260806 17:01:25.116997 27897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:25.117309 27897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:25.117357 27897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:25.122650 27897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:25.122754 27897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:25.122819 27897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:25.128321 27897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:25.129669 27897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:25.131250 27897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:25.142875 27902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:25.142933 27903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:25.142925 27897 server_base.cc:1034] running on GCE node
W20260806 17:01:25.143440 27906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:25.143965 27897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:25.144765 27897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:25.146009 27897 hybrid_clock.cc:648] HybridClock initialized: now 1786035685145980 us; error 42 us; skew 500 ppm
I20260806 17:01:25.148095 27897 webserver.cc:460] Webserver started at http://127.7.153.2:44245/ using document root <none> and password file <none>
I20260806 17:01:25.148824 27897 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:25.148927 27897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:25.149192 27897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:25.151432 27897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "fa0507003c36475d910128e08bd655ab"
format_stamp: "Formatted at 2026-08-06 17:01:25 on dist-test-slave-cbsf"
server_key: "d376f0275bea2ac8af9e784bb82f23d4"
server_key_iv: "84d768e211bdca64517f26c5a2c23a27"
server_key_version: "encryptionkey@0"
I20260806 17:01:25.152037 27897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "fa0507003c36475d910128e08bd655ab"
format_stamp: "Formatted at 2026-08-06 17:01:25 on dist-test-slave-cbsf"
server_key: "d376f0275bea2ac8af9e784bb82f23d4"
server_key_iv: "84d768e211bdca64517f26c5a2c23a27"
server_key_version: "encryptionkey@0"
I20260806 17:01:25.156450 27897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 17:01:25.159413 27913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:25.160948 27897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:25.161129 27897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "fa0507003c36475d910128e08bd655ab"
format_stamp: "Formatted at 2026-08-06 17:01:25 on dist-test-slave-cbsf"
server_key: "d376f0275bea2ac8af9e784bb82f23d4"
server_key_iv: "84d768e211bdca64517f26c5a2c23a27"
server_key_version: "encryptionkey@0"
I20260806 17:01:25.161278 27897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:25.175246 27897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:25.176033 27897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:25.176252 27897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:25.176972 27897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:25.178035 27897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:25.178110 27897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:25.178191 27897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:25.178236 27897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:25.187743 27897 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:39759
I20260806 17:01:25.187767 28042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:39759 every 8 connection(s)
I20260806 17:01:25.188822 27897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:01:25.195909 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 27897
I20260806 17:01:25.196058 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:01:25.196375 7780 external_mini_cluster.cc:1428] Setting key f95cda0d71c000e285b45261920509fe
I20260806 17:01:25.199081 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41361
--builtin_ntp_servers=127.7.153.20:46695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 17:01:25.200229 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.190844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:49701 (local address 127.7.153.62:41361)
0806 17:01:25.191030 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.191035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.192254 (+ 1219us) server_negotiation.cc:407] Connection header received
0806 17:01:25.193785 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.193789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.193848 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.193931 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:25.195043 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.195592 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.197428 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.197787 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.197891 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.199666 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:25.199675 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:25.199678 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:25.199690 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:25.199712 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:25.199720 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:25.199824 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.200005 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.200074 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 17:01:25.201315 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.191272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41361 (local address 127.7.153.2:49701)
0806 17:01:25.192099 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.192145 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.193526 (+ 1381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.194158 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.194165 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.194251 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:25.194797 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.194811 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.195995 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.195998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.197289 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.197299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.198028 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.198032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.198200 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.199113 (+ 913us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:25.199115 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:25.199198 (+ 83us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:25.199489 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:25.199826 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:25.199838 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:25.199847 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.199994 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.200350 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":131,"threads_started":1}
I20260806 17:01:25.203114 28043 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41361
I20260806 17:01:25.203451 28043 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:25.204082 28043 heartbeater.cc:511] Master 127.7.153.62:41361 requested a full tablet report, sending...
I20260806 17:01:25.205310 27688 ts_manager.cc:194] Registered new tserver with Master: fa0507003c36475d910128e08bd655ab (127.7.153.2:39759)
I20260806 17:01:25.206001 27688 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.2:49701
W20260806 17:01:25.335857 28046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:25.336189 28046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:25.336231 28046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:25.341396 28046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:25.341502 28046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:25.341593 28046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:25.348559 28046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:41361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:25.349852 28046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:25.351354 28046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:25.362603 28052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:25.362571 28051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:25.362881 28046 server_base.cc:1034] running on GCE node
W20260806 17:01:25.362571 28054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:25.363441 28046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:25.364162 28046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:25.365387 28046 hybrid_clock.cc:648] HybridClock initialized: now 1786035685365363 us; error 34 us; skew 500 ppm
I20260806 17:01:25.367539 28046 webserver.cc:460] Webserver started at http://127.7.153.3:36907/ using document root <none> and password file <none>
I20260806 17:01:25.368193 28046 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:25.368261 28046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:25.368495 28046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:25.370854 28046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54"
format_stamp: "Formatted at 2026-08-06 17:01:25 on dist-test-slave-cbsf"
server_key: "92ed2cc3219f96747eb4ca44d82dd63d"
server_key_iv: "b93028911c3a1705079bd655dcc2608f"
server_key_version: "encryptionkey@0"
I20260806 17:01:25.371507 28046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54"
format_stamp: "Formatted at 2026-08-06 17:01:25 on dist-test-slave-cbsf"
server_key: "92ed2cc3219f96747eb4ca44d82dd63d"
server_key_iv: "b93028911c3a1705079bd655dcc2608f"
server_key_version: "encryptionkey@0"
I20260806 17:01:25.375622 28046 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 17:01:25.378391 28060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:25.379760 28046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 17:01:25.379912 28046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54"
format_stamp: "Formatted at 2026-08-06 17:01:25 on dist-test-slave-cbsf"
server_key: "92ed2cc3219f96747eb4ca44d82dd63d"
server_key_iv: "b93028911c3a1705079bd655dcc2608f"
server_key_version: "encryptionkey@0"
I20260806 17:01:25.380041 28046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:25.392659 28046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:25.393528 28046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:25.393750 28046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:25.394378 28046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:25.395399 28046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:25.395471 28046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:25.395543 28046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:25.395596 28046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:25.404979 28046 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:37749
I20260806 17:01:25.405006 28191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:37749 every 8 connection(s)
I20260806 17:01:25.406068 28046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:25.411326 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28046
I20260806 17:01:25.411465 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:01:25.411818 7780 external_mini_cluster.cc:1428] Setting key b8c706e90bb5bc5e549ee06ef207fc17
I20260806 17:01:25.416642 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.408150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:33397 (local address 127.7.153.62:41361)
0806 17:01:25.408321 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.408325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.409474 (+ 1149us) server_negotiation.cc:407] Connection header received
0806 17:01:25.410863 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.410866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.410919 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.410997 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:25.412340 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.413177 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.414727 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.414951 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.415046 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.416182 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:25.416185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:25.416187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:25.416200 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:25.416219 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:25.416227 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:25.416288 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.416452 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.416509 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 17:01:25.417793 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.408553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:41361 (local address 127.7.153.3:33397)
0806 17:01:25.409320 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.409363 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.410663 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.411248 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.411259 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.411382 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:25.412152 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.412180 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.413379 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.413385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.414578 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.414589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.415098 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.415101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.415257 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.415896 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:25.415897 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:25.415943 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:25.416019 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:25.416303 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:25.416310 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:25.416315 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.416432 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.416719 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":176,"threads_started":1}
I20260806 17:01:25.419255 28192 heartbeater.cc:347] Connected to a master server at 127.7.153.62:41361
I20260806 17:01:25.419503 28192 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:25.420092 28192 heartbeater.cc:511] Master 127.7.153.62:41361 requested a full tablet report, sending...
I20260806 17:01:25.421402 27688 ts_manager.cc:194] Registered new tserver with Master: b0f17b6a9ffe4f0fbb6fb733641afb54 (127.7.153.3:37749)
I20260806 17:01:25.422118 27688 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.3:33397
I20260806 17:01:25.426420 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:01:25.432600 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.428682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33472 (local address 127.7.153.62:41361)
0806 17:01:25.428844 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.428848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.428923 (+ 75us) server_negotiation.cc:407] Connection header received
0806 17:01:25.429033 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.429036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.429078 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.429163 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:25.429440 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.429981 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.430950 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.431176 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.431265 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.432149 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:25.432152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:25.432154 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:25.432168 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:25.432188 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:25.432196 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:25.432294 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.432431 (+ 137us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.432467 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 17:01:25.436555 27688 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33472:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:01:25.440367 27688 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:01:25.457142 28208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.450994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:39047 (local address 127.0.0.1:49012)
0806 17:01:25.451712 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.451727 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.451835 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.452433 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.452440 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.452476 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:25.452757 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.452766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.453970 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.453973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.455539 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.455550 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.456723 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.456727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.456826 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.456848 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.456893 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.456947 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":126,"thread_start_us":102,"threads_started":1}
I20260806 17:01:25.457188 28207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.450530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39180 (local address 127.7.153.2:39759)
0806 17:01:25.451041 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.451052 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.451295 (+ 243us) server_negotiation.cc:407] Connection header received
0806 17:01:25.452094 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.452099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.452259 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.452379 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:25.452928 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.454150 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.455673 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.456307 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.456456 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.456681 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.456854 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.456971 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":99,"threads_started":1}
I20260806 17:01:25.457463 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.450381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:39759 (local address 127.0.0.1:39180)
0806 17:01:25.451116 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.451132 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.451951 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.452518 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.452521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.452552 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:25.452795 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.452801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.454276 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.454279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.455539 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.455549 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.456454 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.456457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.456574 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.456645 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.456804 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.456947 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"mutex_wait_us":99,"spinlock_wait_cycles":7040,"thread_start_us":120,"threads_started":1}
I20260806 17:01:25.458194 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.451322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49012 (local address 127.7.153.1:39047)
0806 17:01:25.451606 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.451614 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.451813 (+ 199us) server_negotiation.cc:407] Connection header received
0806 17:01:25.451997 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.452004 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.452235 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.452434 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:25.452887 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.453817 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.455693 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.456557 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.457040 (+ 483us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.457257 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.457675 (+ 418us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.457791 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":115,"threads_started":1}
I20260806 17:01:25.458753 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.450133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:37749 (local address 127.0.0.1:35804)
0806 17:01:25.451045 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.451107 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.451687 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.452518 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.452522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.452553 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:25.452787 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.452796 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.455160 (+ 2364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.455164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.456246 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.456257 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.457885 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.457891 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.458203 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.458352 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.458461 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.458577 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":85,"spinlock_wait_cycles":7552,"thread_start_us":108,"threads_started":1}
I20260806 17:01:25.459219 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.450316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35804 (local address 127.7.153.3:37749)
0806 17:01:25.450945 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.450958 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.451359 (+ 401us) server_negotiation.cc:407] Connection header received
0806 17:01:25.451938 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.451944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.452189 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.452355 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:25.452928 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.454157 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.456389 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.457752 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.457868 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.458040 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.458923 (+ 883us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.459041 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":104,"threads_started":1}
I20260806 17:01:25.460810 27966 tablet_service.cc:1467] Processing CreateTablet for tablet e73d14d630c44c80a7016b8bbc208609 (DEFAULT_TABLE table=test-table [id=4841920a417743ce947a1844f399103f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:25.460944 27823 tablet_service.cc:1467] Processing CreateTablet for tablet e73d14d630c44c80a7016b8bbc208609 (DEFAULT_TABLE table=test-table [id=4841920a417743ce947a1844f399103f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:25.461834 27966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e73d14d630c44c80a7016b8bbc208609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:25.461834 27823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e73d14d630c44c80a7016b8bbc208609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:25.466543 28113 tablet_service.cc:1467] Processing CreateTablet for tablet e73d14d630c44c80a7016b8bbc208609 (DEFAULT_TABLE table=test-table [id=4841920a417743ce947a1844f399103f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:25.467865 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e73d14d630c44c80a7016b8bbc208609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:25.469964 28211 tablet_bootstrap.cc:492] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Bootstrap starting.
I20260806 17:01:25.472544 28211 tablet_bootstrap.cc:654] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:25.473101 28210 tablet_bootstrap.cc:492] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: Bootstrap starting.
I20260806 17:01:25.473526 28211 log.cc:824] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:25.475427 28210 tablet_bootstrap.cc:654] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:25.476166 28210 log.cc:824] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:25.476330 28211 tablet_bootstrap.cc:492] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: No bootstrap required, opened a new log
I20260806 17:01:25.476547 28211 ts_tablet_manager.cc:1397] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 17:01:25.477088 28214 tablet_bootstrap.cc:492] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Bootstrap starting.
I20260806 17:01:25.478434 28210 tablet_bootstrap.cc:492] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: No bootstrap required, opened a new log
I20260806 17:01:25.478628 28210 ts_tablet_manager.cc:1397] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 17:01:25.479509 28214 tablet_bootstrap.cc:654] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:25.480152 28211 raft_consensus.cc:348] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.480372 28211 raft_consensus.cc:374] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:25.480403 28211 raft_consensus.cc:729] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa0507003c36475d910128e08bd655ab, State: Initialized, Role: FOLLOWER
I20260806 17:01:25.480388 28214 log.cc:824] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:25.480918 28211 consensus_queue.cc:260] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.481657 28043 heartbeater.cc:503] Master 127.7.153.62:41361 was elected leader, sending a full tablet report...
I20260806 17:01:25.482713 28214 tablet_bootstrap.cc:492] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: No bootstrap required, opened a new log
I20260806 17:01:25.482956 28214 ts_tablet_manager.cc:1397] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 17:01:25.483330 28211 ts_tablet_manager.cc:1428] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 17:01:25.483685 28210 raft_consensus.cc:348] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.483973 28210 raft_consensus.cc:374] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:25.484148 28210 raft_consensus.cc:729] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e84f64800644e8ba52e163359405948, State: Initialized, Role: FOLLOWER
I20260806 17:01:25.484642 28210 consensus_queue.cc:260] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.485415 27893 heartbeater.cc:503] Master 127.7.153.62:41361 was elected leader, sending a full tablet report...
I20260806 17:01:25.487707 28210 ts_tablet_manager.cc:1428] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260806 17:01:25.487517 28214 raft_consensus.cc:348] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.487869 28214 raft_consensus.cc:374] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:25.487933 28214 raft_consensus.cc:729] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f17b6a9ffe4f0fbb6fb733641afb54, State: Initialized, Role: FOLLOWER
I20260806 17:01:25.488406 28214 consensus_queue.cc:260] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.489143 28192 heartbeater.cc:503] Master 127.7.153.62:41361 was elected leader, sending a full tablet report...
I20260806 17:01:25.489528 28214 ts_tablet_manager.cc:1428] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260806 17:01:25.496592 28219 raft_consensus.cc:482] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:25.496894 28219 raft_consensus.cc:504] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.498178 28219 leader_election.cc:288] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa0507003c36475d910128e08bd655ab (127.7.153.2:39759), 6e84f64800644e8ba52e163359405948 (127.7.153.1:39047)
I20260806 17:01:25.503218 28207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.498531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:38275 (local address 127.7.153.2:39759)
0806 17:01:25.498656 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.498661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.498680 (+ 19us) server_negotiation.cc:407] Connection header received
0806 17:01:25.498765 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.498768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.498823 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.498909 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:25.499269 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.500085 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.501936 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.502521 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.502660 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.502722 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.502967 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.503052 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 17:01:25.503227 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.498382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:39759 (local address 127.7.153.3:38275)
0806 17:01:25.498530 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.498547 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.498653 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.498957 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.498963 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.498990 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:25.499141 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.499148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.500225 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.500228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.501722 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.501735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.502670 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.502674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.502827 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.502852 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.502947 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.503065 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":35}
I20260806 17:01:25.503218 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.498701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:40787 (local address 127.7.153.1:39047)
0806 17:01:25.498818 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.498822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.499056 (+ 234us) server_negotiation.cc:407] Connection header received
0806 17:01:25.499113 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.499115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.499158 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.499258 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:25.499515 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.500231 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.501872 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.502428 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.502568 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.502640 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.502962 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.503051 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 17:01:25.503258 28220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.498506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:39047 (local address 127.7.153.3:40787)
0806 17:01:25.498941 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.498954 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:25.499043 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:25.499286 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:25.499289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:25.499304 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:25.499394 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.499398 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.500334 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.500337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.501728 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:25.501735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.502639 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.502644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:25.502798 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.502840 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 17:01:25.502942 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 17:01:25.503068 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":157,"thread_start_us":150,"threads_started":1}
I20260806 17:01:25.504036 27845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e73d14d630c44c80a7016b8bbc208609" candidate_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e84f64800644e8ba52e163359405948" is_pre_election: true
I20260806 17:01:25.504464 27845 raft_consensus.cc:2454] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f17b6a9ffe4f0fbb6fb733641afb54 in term 0.
I20260806 17:01:25.504511 27990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e73d14d630c44c80a7016b8bbc208609" candidate_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa0507003c36475d910128e08bd655ab" is_pre_election: true
I20260806 17:01:25.504846 27990 raft_consensus.cc:2454] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f17b6a9ffe4f0fbb6fb733641afb54 in term 0.
I20260806 17:01:25.505151 28062 leader_election.cc:302] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e84f64800644e8ba52e163359405948, b0f17b6a9ffe4f0fbb6fb733641afb54; no voters:
I20260806 17:01:25.505546 28219 raft_consensus.cc:2781] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:01:25.505646 28219 raft_consensus.cc:482] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:01:25.505681 28219 raft_consensus.cc:3037] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:25.506817 28219 raft_consensus.cc:504] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.507229 28219 leader_election.cc:288] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [CANDIDATE]: Term 1 election: Requested vote from peers fa0507003c36475d910128e08bd655ab (127.7.153.2:39759), 6e84f64800644e8ba52e163359405948 (127.7.153.1:39047)
I20260806 17:01:25.507738 27990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e73d14d630c44c80a7016b8bbc208609" candidate_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa0507003c36475d910128e08bd655ab"
I20260806 17:01:25.507755 27845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e73d14d630c44c80a7016b8bbc208609" candidate_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e84f64800644e8ba52e163359405948"
I20260806 17:01:25.507923 27990 raft_consensus.cc:3037] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:25.507933 27845 raft_consensus.cc:3037] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:25.509172 27990 raft_consensus.cc:2454] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f17b6a9ffe4f0fbb6fb733641afb54 in term 1.
I20260806 17:01:25.509182 27845 raft_consensus.cc:2454] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f17b6a9ffe4f0fbb6fb733641afb54 in term 1.
I20260806 17:01:25.509581 28062 leader_election.cc:302] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e84f64800644e8ba52e163359405948, b0f17b6a9ffe4f0fbb6fb733641afb54; no voters:
I20260806 17:01:25.509791 28219 raft_consensus.cc:2781] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:25.510083 28219 raft_consensus.cc:686] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 1 LEADER]: Becoming Leader. State: Replica: b0f17b6a9ffe4f0fbb6fb733641afb54, State: Running, Role: LEADER
I20260806 17:01:25.510474 28219 consensus_queue.cc:237] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } }
I20260806 17:01:25.515022 27688 catalog_manager.cc:5495] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f17b6a9ffe4f0fbb6fb733641afb54 (127.7.153.3). New cstate: current_term: 1 leader_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f17b6a9ffe4f0fbb6fb733641afb54" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 37749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 } health_report { overall_health: UNKNOWN } } }
I20260806 17:01:25.542259 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.537589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.7.153.3:37749)
0806 17:01:25.537719 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:25.537722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:25.537735 (+ 13us) server_negotiation.cc:407] Connection header received
0806 17:01:25.537813 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:25.537815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:25.537876 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:25.537979 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:01:25.538438 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.539281 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.540358 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:25.540598 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:25.540941 (+ 343us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:25.541259 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:01:25.541740 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:01:25.541865 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:25.542044 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 17:01:25.542085 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 17:01:25.549327 27845 raft_consensus.cc:1261] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 1 FOLLOWER]: Refusing update from remote peer b0f17b6a9ffe4f0fbb6fb733641afb54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:25.549327 27990 raft_consensus.cc:1261] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 1 FOLLOWER]: Refusing update from remote peer b0f17b6a9ffe4f0fbb6fb733641afb54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:25.550191 28222 consensus_queue.cc:1035] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e84f64800644e8ba52e163359405948" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 39047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:25.550406 28219 consensus_queue.cc:1035] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa0507003c36475d910128e08bd655ab" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:25.561492 28228 mvcc.cc:205] Tried to move back new op lower bound from 7315602168000540672 to 7315602167854264320. Current Snapshot: MvccSnapshot[applied={T|T < 7315602168000540672}]
I20260806 17:01:25.573930 27688 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33472:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:25.574184 27688 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33472:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:25.577137 27688 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe782ef7787e48f6b7c4e9918bf71c09: Sending DeleteTablet for 3 replicas of tablet e73d14d630c44c80a7016b8bbc208609
I20260806 17:01:25.578136 28113 tablet_service.cc:1514] Processing DeleteTablet for tablet e73d14d630c44c80a7016b8bbc208609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:25 UTC) from {username='slave'} at 127.0.0.1:35804
I20260806 17:01:25.578135 27823 tablet_service.cc:1514] Processing DeleteTablet for tablet e73d14d630c44c80a7016b8bbc208609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:25 UTC) from {username='slave'} at 127.0.0.1:49012
I20260806 17:01:25.578179 27966 tablet_service.cc:1514] Processing DeleteTablet for tablet e73d14d630c44c80a7016b8bbc208609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:25 UTC) from {username='slave'} at 127.0.0.1:39180
I20260806 17:01:25.579011 28236 tablet_replica.cc:330] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: stopping tablet replica
I20260806 17:01:25.579329 28237 tablet_replica.cc:330] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948: stopping tablet replica
I20260806 17:01:25.579633 28237 raft_consensus.cc:2229] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:25.579635 28236 raft_consensus.cc:2229] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:01:25.580236 28237 raft_consensus.cc:2258] T e73d14d630c44c80a7016b8bbc208609 P 6e84f64800644e8ba52e163359405948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:25.580369 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27752
I20260806 17:01:25.582973 28238 tablet_replica.cc:330] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: stopping tablet replica
I20260806 17:01:25.583431 28238 raft_consensus.cc:2229] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:25.583894 28238 raft_consensus.cc:2258] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:25.585150 28236 raft_consensus.cc:2258] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:25.586699 28238 ts_tablet_manager.cc:1905] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:25.586731 28236 ts_tablet_manager.cc:1905] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:25.589165 28238 ts_tablet_manager.cc:1918] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:25.589298 28238 log.cc:1196] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/e73d14d630c44c80a7016b8bbc208609
I20260806 17:01:25.589669 28238 ts_tablet_manager.cc:1939] T e73d14d630c44c80a7016b8bbc208609 P fa0507003c36475d910128e08bd655ab: Deleting consensus metadata
I20260806 17:01:25.590518 28236 ts_tablet_manager.cc:1918] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:25.590639 28236 log.cc:1196] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/e73d14d630c44c80a7016b8bbc208609
I20260806 17:01:25.590986 28236 ts_tablet_manager.cc:1939] T e73d14d630c44c80a7016b8bbc208609 P b0f17b6a9ffe4f0fbb6fb733641afb54: Deleting consensus metadata
I20260806 17:01:25.591213 27671 catalog_manager.cc:4841] TS fa0507003c36475d910128e08bd655ab (127.7.153.2:39759): tablet e73d14d630c44c80a7016b8bbc208609 (table test-table [id=4841920a417743ce947a1844f399103f]) successfully deleted
I20260806 17:01:25.592240 27673 catalog_manager.cc:4841] TS b0f17b6a9ffe4f0fbb6fb733641afb54 (127.7.153.3:37749): tablet e73d14d630c44c80a7016b8bbc208609 (table test-table [id=4841920a417743ce947a1844f399103f]) successfully deleted
W20260806 17:01:25.592381 27672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:39047 (error 108)
I20260806 17:01:25.593194 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27897
I20260806 17:01:25.593525 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:25.593216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:39047 (local address 127.0.0.1:49014)
0806 17:01:25.593351 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:25.593425 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:39047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 17:01:25.599797 27672 catalog_manager.cc:4584] TS 6e84f64800644e8ba52e163359405948 (127.7.153.1:39047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e73d14d630c44c80a7016b8bbc208609: Network error: Client connection negotiation failed: client connection to 127.7.153.1:39047: connect: Connection refused (error 111)
I20260806 17:01:25.606293 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28046
I20260806 17:01:25.614764 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 27655
2026-08-06T17:01:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1180 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:25 dist-test-slave-cbsf krb5kdc[28242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:25 dist-test-slave-cbsf krb5kdc[28242](info): set up 2 sockets
Aug 06 17:01:25 dist-test-slave-cbsf krb5kdc[28242](info): commencing operation
krb5kdc: starting...
W20260806 17:01:26.727662 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:26 dist-test-slave-cbsf krb5kdc[28242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:26.872893 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:38119
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:38119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:27.003301 28257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:27.003624 28257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:27.003670 28257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:27.008066 28257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:27.008162 28257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:27.008181 28257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:27.008201 28257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:27.008216 28257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:27.014205 28257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:38119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:38119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:27.015399 28257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:27.016474 28257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 17:01:27.025805 28257 server_base.cc:1034] running on GCE node
W20260806 17:01:27.025746 28267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:27.025753 28264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:27.025746 28263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:27.026767 28257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:27.027930 28257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:27.029165 28257 hybrid_clock.cc:648] HybridClock initialized: now 1786035687029147 us; error 39 us; skew 500 ppm
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:27.032392 28257 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:27.033497 28257 webserver.cc:460] Webserver started at http://127.7.153.62:32823/ using document root <none> and password file <none>
I20260806 17:01:27.034286 28257 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:27.034403 28257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:27.034688 28257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:27.037055 28257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "e1aede9c1c5447f9be8a041e684ab348"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "be363e15b5b3b8387daff9d90755aa97"
server_key_iv: "29dc488d9f7d73345483fc618cd1c72a"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.037703 28257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "e1aede9c1c5447f9be8a041e684ab348"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "be363e15b5b3b8387daff9d90755aa97"
server_key_iv: "29dc488d9f7d73345483fc618cd1c72a"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.042408 28257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:27.045181 28275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.046622 28257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:27.046785 28257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "e1aede9c1c5447f9be8a041e684ab348"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "be363e15b5b3b8387daff9d90755aa97"
server_key_iv: "29dc488d9f7d73345483fc618cd1c72a"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.046921 28257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:27.061313 28257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:27.065460 28257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:27.065734 28257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:27.074466 28257 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:38119
I20260806 17:01:27.074479 28331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:38119 every 8 connection(s)
I20260806 17:01:27.075572 28257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:27.079309 28332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:27.081995 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28257
I20260806 17:01:27.082127 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:27.082470 7780 external_mini_cluster.cc:1428] Setting key 941c143f9f9992125785d3f32d7f80bd
I20260806 17:01:27.086222 28332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348: Bootstrap starting.
I20260806 17:01:27.089068 28332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:27.089960 28332 log.cc:824] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348: Log is configured to *not* fsync() on all Append() calls
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:27.093640 28332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348: No bootstrap required, opened a new log
I20260806 17:01:27.098367 28332 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1aede9c1c5447f9be8a041e684ab348" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38119 } }
I20260806 17:01:27.098620 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.084098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53920 (local address 127.7.153.62:38119)
0806 17:01:27.084565 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.084582 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.084626 (+ 44us) server_negotiation.cc:407] Connection header received
0806 17:01:27.085349 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.085368 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.085743 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.086032 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:27.087016 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.088082 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.089343 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.089869 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.090000 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.092937 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:27.092946 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:27.092974 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:27.093029 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:27.095403 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.095929 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.095935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.095940 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.096075 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.096372 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.096375 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.096377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.096902 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:27.097166 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.097410 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.097753 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":153,"threads_started":1}
I20260806 17:01:27.098670 28332 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:27.098735 28332 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1aede9c1c5447f9be8a041e684ab348, State: Initialized, Role: FOLLOWER
I20260806 17:01:27.099299 28332 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1aede9c1c5447f9be8a041e684ab348" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38119 } }
I20260806 17:01:27.099467 28332 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:27.099537 28332 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:27.099623 28332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:27.100747 28332 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1aede9c1c5447f9be8a041e684ab348" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38119 } }
I20260806 17:01:27.101178 28332 leader_election.cc:302] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1aede9c1c5447f9be8a041e684ab348; no voters:
I20260806 17:01:27.101557 28332 leader_election.cc:288] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:27.101696 28339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:27.101940 28339 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [term 1 LEADER]: Becoming Leader. State: Replica: e1aede9c1c5447f9be8a041e684ab348, State: Running, Role: LEADER
I20260806 17:01:27.102278 28339 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1aede9c1c5447f9be8a041e684ab348" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38119 } }
I20260806 17:01:27.102931 28332 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:27.104203 28344 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1aede9c1c5447f9be8a041e684ab348. Latest consensus state: current_term: 1 leader_uuid: "e1aede9c1c5447f9be8a041e684ab348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1aede9c1c5447f9be8a041e684ab348" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38119 } } }
I20260806 17:01:27.104347 28344 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:27.104650 28340 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1aede9c1c5447f9be8a041e684ab348" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1aede9c1c5447f9be8a041e684ab348" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38119 } } }
I20260806 17:01:27.104786 28340 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:27.104913 28351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:27.108345 28351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:27.114490 28351 catalog_manager.cc:1347] Generated new cluster ID: 2ec27ec3c2794bf487ef899b66becd09
I20260806 17:01:27.114590 28351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:27.124120 28351 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:27.125505 28351 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:27.132037 28351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348: Generated new TSK 0
I20260806 17:01:27.133059 28351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.153.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
Entry for principal kudu/127.7.153.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab.
I20260806 17:01:27.175634 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:38119
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:27.303853 28363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:27.304236 28363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:27.304327 28363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:27.308833 28363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:27.308938 28363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:27.309007 28363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:27.314944 28363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.1.keytab
--principal=kudu/127.7.153.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:38119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:27.316277 28363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:27.317543 28363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 17:01:27.328538 28363 server_base.cc:1034] running on GCE node
W20260806 17:01:27.328478 28369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:27.328488 28371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:27.328503 28368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:27.329169 28363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:27.329984 28363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:27.331218 28363 hybrid_clock.cc:648] HybridClock initialized: now 1786035687331173 us; error 60 us; skew 500 ppm
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:27.334693 28363 init.cc:377] Logged in from keytab as kudu/127.7.153.1@KRBTEST.COM (short username kudu)
I20260806 17:01:27.335781 28363 webserver.cc:460] Webserver started at http://127.7.153.1:40217/ using document root <none> and password file <none>
I20260806 17:01:27.336441 28363 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:27.336556 28363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:27.336889 28363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:27.339299 28363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "ffe5d7e13d9442b7bb9e88d529a8e287"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "a0ecbdb44c52785204bcd482d2b0c901"
server_key_iv: "c677cdc63f62db9a6add91719f23d95e"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.339974 28363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "ffe5d7e13d9442b7bb9e88d529a8e287"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "a0ecbdb44c52785204bcd482d2b0c901"
server_key_iv: "c677cdc63f62db9a6add91719f23d95e"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.344518 28363 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 17:01:27.347854 28378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.349699 28363 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:27.349870 28363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "ffe5d7e13d9442b7bb9e88d529a8e287"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "a0ecbdb44c52785204bcd482d2b0c901"
server_key_iv: "c677cdc63f62db9a6add91719f23d95e"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.350070 28363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:27.369552 28363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:27.373983 28363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:27.374238 28363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:27.374931 28363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:27.375898 28363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:27.375974 28363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.376048 28363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:27.376101 28363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.387422 28363 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:34319
I20260806 17:01:27.387454 28502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:34319 every 8 connection(s)
I20260806 17:01:27.388481 28363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:27.394763 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28363
I20260806 17:01:27.394907 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:01:27.395247 7780 external_mini_cluster.cc:1428] Setting key 8ac6979e667852782e96fea8f89ae32b
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.1@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:27.406191 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.390579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:50483 (local address 127.7.153.62:38119)
0806 17:01:27.390815 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.390819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.391730 (+ 911us) server_negotiation.cc:407] Connection header received
0806 17:01:27.392636 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.392639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.392688 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.392847 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:27.394440 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.395260 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.397504 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.397785 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.397912 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.401078 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:27.401082 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:27.401084 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:27.401123 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:27.403176 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.404128 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.404131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.404133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.404229 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.404792 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.404795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.404797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.405021 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:27.405118 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.405898 (+ 780us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.406054 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
WARNING: no policy specified for kudu/127.7.153.2@KRBTEST.COM; defaulting to no policy
I20260806 17:01:27.407578 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.390993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:38119 (local address 127.7.153.1:50483)
0806 17:01:27.391527 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:27.391574 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:27.392429 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:27.393072 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:27.393080 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:27.393631 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:27.394159 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.394173 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.395542 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.395546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.397319 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.397350 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.397980 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.397984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.398195 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.398925 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:27.398945 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:27.400810 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:27.403344 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:27.403356 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:27.403385 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:27.403969 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:27.404365 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:27.404371 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:27.404375 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:27.404614 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:27.405149 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:27.405158 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:27.405582 (+ 424us) client_negotiation.cc:769] Sending connection context
0806 17:01:27.405846 (+ 264us) client_negotiation.cc:240] Negotiation successful
0806 17:01:27.406283 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":140,"threads_started":1}
I20260806 17:01:27.409721 28503 heartbeater.cc:347] Connected to a master server at 127.7.153.62:38119
I20260806 17:01:27.410090 28503 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:27.410750 28503 heartbeater.cc:511] Master 127.7.153.62:38119 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.2@KRBTEST.COM" created.
I20260806 17:01:27.412647 28293 ts_manager.cc:194] Registered new tserver with Master: ffe5d7e13d9442b7bb9e88d529a8e287 (127.7.153.1:34319)
I20260806 17:01:27.413973 28293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.1@KRBTEST.COM'} at 127.7.153.1:50483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
Entry for principal kudu/127.7.153.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab.
I20260806 17:01:27.432888 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:38119
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:27.557422 28508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:27.557749 28508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:27.557832 28508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:27.562283 28508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:27.562368 28508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:27.562453 28508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:27.568346 28508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.2.keytab
--principal=kudu/127.7.153.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:38119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:27.569659 28508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:27.570771 28508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:27.581459 28515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:27.581485 28514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:27.581663 28508 server_base.cc:1034] running on GCE node
W20260806 17:01:27.581483 28517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:27.582396 28508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:27.583176 28508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:27.584398 28508 hybrid_clock.cc:648] HybridClock initialized: now 1786035687584375 us; error 40 us; skew 500 ppm
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:27.587659 28508 init.cc:377] Logged in from keytab as kudu/127.7.153.2@KRBTEST.COM (short username kudu)
I20260806 17:01:27.588675 28508 webserver.cc:460] Webserver started at http://127.7.153.2:33575/ using document root <none> and password file <none>
I20260806 17:01:27.589339 28508 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:27.589402 28508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:27.589582 28508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:27.591886 28508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "46babe4791894165ad1fa6ba89fda8de"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "1262797ee1ec4849ee4564bec2583cb0"
server_key_iv: "3e7660c9fb15ad716830fb258eaab9e2"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.592446 28508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "46babe4791894165ad1fa6ba89fda8de"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "1262797ee1ec4849ee4564bec2583cb0"
server_key_iv: "3e7660c9fb15ad716830fb258eaab9e2"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.596565 28508 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260806 17:01:27.599642 28524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.601262 28508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:27.601428 28508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "46babe4791894165ad1fa6ba89fda8de"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "1262797ee1ec4849ee4564bec2583cb0"
server_key_iv: "3e7660c9fb15ad716830fb258eaab9e2"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.601573 28508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:27.621014 28508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:27.625166 28508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:27.625351 28508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:27.625958 28508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:27.626830 28508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:27.626880 28508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.626920 28508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:27.626936 28508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.636983 28508 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:43291
I20260806 17:01:27.637045 28651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:43291 every 8 connection(s)
I20260806 17:01:27.638125 28508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:01:27.642133 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28508
I20260806 17:01:27.642269 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:01:27.642598 7780 external_mini_cluster.cc:1428] Setting key 38485354cbc66263c46f4e94e872169a
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.2@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.3@KRBTEST.COM; defaulting to no policy
I20260806 17:01:27.656047 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.640202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:48453 (local address 127.7.153.62:38119)
0806 17:01:27.640356 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.640360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.641330 (+ 970us) server_negotiation.cc:407] Connection header received
0806 17:01:27.642556 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.642559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.642617 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.642840 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:27.644156 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.644787 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.646888 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.647291 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.647434 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.651332 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:27.651338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:27.651345 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:27.651391 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:27.653353 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.654035 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.654041 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.654046 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.654153 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.654537 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.654543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.654547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.654834 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:27.654944 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.655678 (+ 734us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.655824 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 17:01:27.657032 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.640594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:38119 (local address 127.7.153.2:48453)
0806 17:01:27.641167 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:27.641214 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:27.642270 (+ 1056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:27.643086 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:27.643094 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:27.643485 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:27.644014 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.644028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.644923 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.644929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.646680 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.646699 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.647504 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.647507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.647687 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.648534 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:27.648570 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:27.651082 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:27.653534 (+ 2452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:27.653541 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:27.653560 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:27.653909 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:27.654266 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:27.654268 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:27.654270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:27.654423 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:27.654955 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:27.654962 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:27.655324 (+ 362us) client_negotiation.cc:769] Sending connection context
0806 17:01:27.655511 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 17:01:27.655973 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":136,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.3@KRBTEST.COM" created.
I20260806 17:01:27.658473 28652 heartbeater.cc:347] Connected to a master server at 127.7.153.62:38119
I20260806 17:01:27.658744 28652 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:27.659335 28652 heartbeater.cc:511] Master 127.7.153.62:38119 requested a full tablet report, sending...
I20260806 17:01:27.660548 28293 ts_manager.cc:194] Registered new tserver with Master: 46babe4791894165ad1fa6ba89fda8de (127.7.153.2:43291)
I20260806 17:01:27.661494 28293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.2@KRBTEST.COM'} at 127.7.153.2:48453
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
Entry for principal kudu/127.7.153.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab.
I20260806 17:01:27.678337 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:38119
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:27.808781 28658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:27.809309 28658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:27.809401 28658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:27.815999 28658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:27.816107 28658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:27.816222 28658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:27.824957 28658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.3.keytab
--principal=kudu/127.7.153.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:38119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:27.826439 28658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:27.827992 28658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:27.841122 28665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:27.841122 28663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:27.841902 28658 server_base.cc:1034] running on GCE node
W20260806 17:01:27.841915 28669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:27.842551 28658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:27.843298 28658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:27.844481 28658 hybrid_clock.cc:648] HybridClock initialized: now 1786035687844437 us; error 67 us; skew 500 ppm
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:27.848559 28658 init.cc:377] Logged in from keytab as kudu/127.7.153.3@KRBTEST.COM (short username kudu)
I20260806 17:01:27.849831 28658 webserver.cc:460] Webserver started at http://127.7.153.3:38091/ using document root <none> and password file <none>
I20260806 17:01:27.850804 28658 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:27.850900 28658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:27.851213 28658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:27.853991 28658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "03659f5a6dd14787b2dae8c2c66a4d83"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "bba269287d10667f004b656de824ca81"
server_key_iv: "08b431cdb2f7318fe7ed0b49f2958d29"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.854959 28658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "03659f5a6dd14787b2dae8c2c66a4d83"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "bba269287d10667f004b656de824ca81"
server_key_iv: "08b431cdb2f7318fe7ed0b49f2958d29"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.860426 28658 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 17:01:27.863881 28676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.865482 28658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:27.865620 28658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "03659f5a6dd14787b2dae8c2c66a4d83"
format_stamp: "Formatted at 2026-08-06 17:01:27 on dist-test-slave-cbsf"
server_key: "bba269287d10667f004b656de824ca81"
server_key_iv: "08b431cdb2f7318fe7ed0b49f2958d29"
server_key_version: "encryptionkey@0"
I20260806 17:01:27.865741 28658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:27.889006 28658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:27.892784 28658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:27.893028 28658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:27.893726 28658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:27.894701 28658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:27.894776 28658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.894855 28658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:27.894899 28658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:27.904839 28658 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:41265
I20260806 17:01:27.904871 28797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:41265 every 8 connection(s)
I20260806 17:01:27.906009 28658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:27.907835 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28658
I20260806 17:01:27.907950 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:01:27.908363 7780 external_mini_cluster.cc:1428] Setting key 91884302573a4c552a614f47c20ee0ab
Aug 06 17:01:27 dist-test-slave-cbsf krb5kdc[28242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035687, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.3@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:27.921849 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.908253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:49233 (local address 127.7.153.62:38119)
0806 17:01:27.908417 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.908423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.909611 (+ 1188us) server_negotiation.cc:407] Connection header received
0806 17:01:27.911296 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.911299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.911347 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.911415 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:27.912667 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.913290 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.914553 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.914788 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.914898 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.917771 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:27.917774 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:27.917776 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:27.917806 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:27.919325 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.919941 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.919946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.919948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.920037 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.920422 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.920427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.920429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.920655 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:27.920810 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.921524 (+ 714us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.921676 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 17:01:27.922874 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.908825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:38119 (local address 127.7.153.3:49233)
0806 17:01:27.909437 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:27.909502 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:27.911081 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:27.911563 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:27.911571 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:27.911975 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:27.912516 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.912530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.913409 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.913411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.914373 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.914383 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.914959 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.914962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.915123 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.915813 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:27.915832 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:27.917552 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:27.919480 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:27.919487 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:27.919509 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:27.919826 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:27.920143 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:27.920146 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:27.920148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:27.920318 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:27.920807 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:27.920817 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:27.921216 (+ 399us) client_negotiation.cc:769] Sending connection context
0806 17:01:27.921467 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 17:01:27.921860 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":162,"threads_started":1}
I20260806 17:01:27.924254 28798 heartbeater.cc:347] Connected to a master server at 127.7.153.62:38119
I20260806 17:01:27.924582 28798 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:27.925334 28798 heartbeater.cc:511] Master 127.7.153.62:38119 requested a full tablet report, sending...
I20260806 17:01:27.926489 28293 ts_manager.cc:194] Registered new tserver with Master: 03659f5a6dd14787b2dae8c2c66a4d83 (127.7.153.3:41265)
I20260806 17:01:27.927155 28293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.153.3@KRBTEST.COM'} at 127.7.153.3:49233
I20260806 17:01:27.935585 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:01:27.946822 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.937932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53924 (local address 127.7.153.62:38119)
0806 17:01:27.938075 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.938078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.938159 (+ 81us) server_negotiation.cc:407] Connection header received
0806 17:01:27.938268 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.938271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.938317 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.938396 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:27.939129 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.939719 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.940808 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.941040 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.941130 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.942834 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:27.942838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:27.942840 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:27.942870 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:27.944439 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.945026 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.945029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.945030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.945117 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:27.945515 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:27.945521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:27.945523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:27.945972 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:27.946156 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.946512 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.946689 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 17:01:27.950536 28293 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:01:27.953976 28293 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:01:27.970165 28818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.964901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35338 (local address 127.7.153.1:34319)
0806 17:01:27.965288 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.965294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.965314 (+ 20us) server_negotiation.cc:407] Connection header received
0806 17:01:27.965386 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.965393 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.965584 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.965713 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:27.965950 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.967055 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.968386 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.969306 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.969431 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.969619 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.969880 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.969991 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":107,"threads_started":1}
I20260806 17:01:27.970160 28817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.964451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34319 (local address 127.0.0.1:35338)
0806 17:01:27.964823 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:27.964836 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:27.964921 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:27.965719 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:27.965725 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:27.965749 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:27.965830 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.965836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.967189 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.967193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.968264 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.968273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.969445 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.969449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.969578 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.969641 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 17:01:27.969767 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 17:01:27.969978 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":41,"thread_start_us":86,"threads_started":1}
I20260806 17:01:27.970504 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.963773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36196 (local address 127.7.153.3:41265)
0806 17:01:27.964882 (+ 1109us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.964895 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.964916 (+ 21us) server_negotiation.cc:407] Connection header received
0806 17:01:27.964995 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.965003 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.965203 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.965358 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:27.965810 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.966629 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.968722 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.969523 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.969624 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.969774 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.970244 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.970362 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1003,"thread_start_us":138,"threads_started":1}
I20260806 17:01:27.970511 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.963867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37684 (local address 127.7.153.2:43291)
0806 17:01:27.964625 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:27.964639 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:27.964669 (+ 30us) server_negotiation.cc:407] Connection header received
0806 17:01:27.964789 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:27.964795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:27.965015 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:27.965585 (+ 570us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:27.965753 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.966990 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.968542 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.969322 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.969452 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.969611 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:27.970229 (+ 618us) server_negotiation.cc:299] Negotiation successful
0806 17:01:27.970339 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":134,"threads_started":1}
I20260806 17:01:27.970160 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.963622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:43291 (local address 127.0.0.1:37684)
0806 17:01:27.964348 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:27.964406 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:27.964558 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:27.965224 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:27.965231 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:27.965256 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:27.965432 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.965439 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.967161 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.967165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.968393 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.968405 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.969675 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.969679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.969783 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.969802 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 17:01:27.969864 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 17:01:27.969961 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":231,"spinlock_wait_cycles":3072,"thread_start_us":146,"threads_started":1}
I20260806 17:01:27.970415 28815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:27.963622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:41265 (local address 127.0.0.1:36196)
0806 17:01:27.964345 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:27.964406 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:27.964558 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:27.965535 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:27.965538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:27.965557 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:27.965671 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.965682 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.966773 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.966779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.968554 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:27.968562 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:27.969843 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:27.969849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:27.969945 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:27.969969 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 17:01:27.970040 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 17:01:27.970123 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":88,"spinlock_wait_cycles":4736,"thread_start_us":97,"threads_started":1}
I20260806 17:01:27.973850 28579 tablet_service.cc:1467] Processing CreateTablet for tablet 98393f8273fd4a11860e8b42be0d7bd4 (DEFAULT_TABLE table=test-table [id=64937221a6804d68b2af1640ed2c3a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:27.973869 28430 tablet_service.cc:1467] Processing CreateTablet for tablet 98393f8273fd4a11860e8b42be0d7bd4 (DEFAULT_TABLE table=test-table [id=64937221a6804d68b2af1640ed2c3a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:27.973876 28728 tablet_service.cc:1467] Processing CreateTablet for tablet 98393f8273fd4a11860e8b42be0d7bd4 (DEFAULT_TABLE table=test-table [id=64937221a6804d68b2af1640ed2c3a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:27.975071 28728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98393f8273fd4a11860e8b42be0d7bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:27.975061 28430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98393f8273fd4a11860e8b42be0d7bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:27.975060 28579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98393f8273fd4a11860e8b42be0d7bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:27.982327 28819 tablet_bootstrap.cc:492] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Bootstrap starting.
I20260806 17:01:27.983562 28821 tablet_bootstrap.cc:492] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: Bootstrap starting.
I20260806 17:01:27.985121 28822 tablet_bootstrap.cc:492] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Bootstrap starting.
I20260806 17:01:27.985822 28819 tablet_bootstrap.cc:654] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:27.985880 28821 tablet_bootstrap.cc:654] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:27.986824 28819 log.cc:824] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:27.986824 28821 log.cc:824] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:27.987061 28822 tablet_bootstrap.cc:654] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:27.988314 28822 log.cc:824] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:27.989264 28821 tablet_bootstrap.cc:492] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: No bootstrap required, opened a new log
I20260806 17:01:27.989264 28819 tablet_bootstrap.cc:492] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: No bootstrap required, opened a new log
I20260806 17:01:27.989493 28819 ts_tablet_manager.cc:1397] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 17:01:27.989493 28821 ts_tablet_manager.cc:1397] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 17:01:27.990236 28822 tablet_bootstrap.cc:492] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: No bootstrap required, opened a new log
I20260806 17:01:27.990443 28822 ts_tablet_manager.cc:1397] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 17:01:27.993554 28822 raft_consensus.cc:348] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:27.993847 28822 raft_consensus.cc:374] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:27.993922 28822 raft_consensus.cc:729] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03659f5a6dd14787b2dae8c2c66a4d83, State: Initialized, Role: FOLLOWER
I20260806 17:01:27.993757 28819 raft_consensus.cc:348] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:27.994082 28819 raft_consensus.cc:374] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:27.994160 28819 raft_consensus.cc:729] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46babe4791894165ad1fa6ba89fda8de, State: Initialized, Role: FOLLOWER
I20260806 17:01:27.994285 28821 raft_consensus.cc:348] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:27.994554 28821 raft_consensus.cc:374] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:27.994485 28822 consensus_queue.cc:260] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:27.994632 28821 raft_consensus.cc:729] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe5d7e13d9442b7bb9e88d529a8e287, State: Initialized, Role: FOLLOWER
I20260806 17:01:27.994665 28819 consensus_queue.cc:260] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:27.995057 28821 consensus_queue.cc:260] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:27.995658 28822 ts_tablet_manager.cc:1428] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 17:01:27.995846 28819 ts_tablet_manager.cc:1428] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 17:01:27.995868 28503 heartbeater.cc:503] Master 127.7.153.62:38119 was elected leader, sending a full tablet report...
I20260806 17:01:27.995988 28798 heartbeater.cc:503] Master 127.7.153.62:38119 was elected leader, sending a full tablet report...
I20260806 17:01:27.996145 28821 ts_tablet_manager.cc:1428] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 17:01:27.996261 28652 heartbeater.cc:503] Master 127.7.153.62:38119 was elected leader, sending a full tablet report...
I20260806 17:01:28.028466 28828 raft_consensus.cc:482] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:28.028754 28828 raft_consensus.cc:504] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:28.030002 28828 leader_election.cc:288] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03659f5a6dd14787b2dae8c2c66a4d83 (127.7.153.3:41265), 46babe4791894165ad1fa6ba89fda8de (127.7.153.2:43291)
I20260806 17:01:28.037097 28814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.030412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:45489 (local address 127.7.153.3:41265)
0806 17:01:28.030567 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:28.030575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:28.030921 (+ 346us) server_negotiation.cc:407] Connection header received
0806 17:01:28.031052 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:28.031055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:28.031112 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:28.031205 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:28.031689 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.032499 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.035533 (+ 3034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.036215 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.036363 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.036434 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:28.036837 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 17:01:28.036959 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 17:01:28.037169 28829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.030299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:43291 (local address 127.7.153.1:40157)
0806 17:01:28.030759 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:28.030775 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:28.030925 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:28.031262 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:28.031266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:28.031309 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:28.031548 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.031556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.032685 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.032715 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.035315 (+ 2600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.035334 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.036384 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.036389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.036629 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.036713 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 17:01:28.036804 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 17:01:28.036935 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":381,"spinlock_wait_cycles":22912,"thread_start_us":131,"threads_started":1}
I20260806 17:01:28.037169 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.030298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:41265 (local address 127.7.153.1:45489)
0806 17:01:28.030809 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:28.030823 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:28.030935 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:28.031262 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:28.031266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:28.031310 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:28.031548 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.031556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.032685 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.032717 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.035315 (+ 2598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.035334 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.036384 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.036389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.036626 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.036716 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 17:01:28.036804 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 17:01:28.036931 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":433,"spinlock_wait_cycles":56832,"thread_start_us":132,"threads_started":1}
I20260806 17:01:28.037755 28816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.030387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:40157 (local address 127.7.153.2:43291)
0806 17:01:28.030590 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:28.030595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:28.030893 (+ 298us) server_negotiation.cc:407] Connection header received
0806 17:01:28.031052 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:28.031056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:28.031112 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:28.031205 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:28.031689 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.032499 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.035527 (+ 3028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.036215 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.036357 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.036434 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:28.037507 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0806 17:01:28.037610 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 17:01:28.038201 28750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98393f8273fd4a11860e8b42be0d7bd4" candidate_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" is_pre_election: true
I20260806 17:01:28.038335 28601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98393f8273fd4a11860e8b42be0d7bd4" candidate_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46babe4791894165ad1fa6ba89fda8de" is_pre_election: true
I20260806 17:01:28.038579 28601 raft_consensus.cc:2454] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe5d7e13d9442b7bb9e88d529a8e287 in term 0.
I20260806 17:01:28.038579 28750 raft_consensus.cc:2454] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe5d7e13d9442b7bb9e88d529a8e287 in term 0.
I20260806 17:01:28.039386 28379 leader_election.cc:302] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 03659f5a6dd14787b2dae8c2c66a4d83, 46babe4791894165ad1fa6ba89fda8de, ffe5d7e13d9442b7bb9e88d529a8e287; no voters:
I20260806 17:01:28.040024 28828 raft_consensus.cc:2781] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:01:28.040199 28828 raft_consensus.cc:482] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:01:28.040413 28828 raft_consensus.cc:3037] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:28.041715 28828 raft_consensus.cc:504] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:28.042255 28828 leader_election.cc:288] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [CANDIDATE]: Term 1 election: Requested vote from peers 03659f5a6dd14787b2dae8c2c66a4d83 (127.7.153.3:41265), 46babe4791894165ad1fa6ba89fda8de (127.7.153.2:43291)
I20260806 17:01:28.042879 28750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98393f8273fd4a11860e8b42be0d7bd4" candidate_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03659f5a6dd14787b2dae8c2c66a4d83"
I20260806 17:01:28.043098 28750 raft_consensus.cc:3037] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:28.043146 28601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98393f8273fd4a11860e8b42be0d7bd4" candidate_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46babe4791894165ad1fa6ba89fda8de"
I20260806 17:01:28.043339 28601 raft_consensus.cc:3037] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:28.044627 28750 raft_consensus.cc:2454] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe5d7e13d9442b7bb9e88d529a8e287 in term 1.
I20260806 17:01:28.044754 28601 raft_consensus.cc:2454] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe5d7e13d9442b7bb9e88d529a8e287 in term 1.
I20260806 17:01:28.045157 28379 leader_election.cc:302] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03659f5a6dd14787b2dae8c2c66a4d83, ffe5d7e13d9442b7bb9e88d529a8e287; no voters:
I20260806 17:01:28.045406 28828 raft_consensus.cc:2781] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:28.045702 28828 raft_consensus.cc:686] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 1 LEADER]: Becoming Leader. State: Replica: ffe5d7e13d9442b7bb9e88d529a8e287, State: Running, Role: LEADER
I20260806 17:01:28.046137 28828 consensus_queue.cc:237] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } }
I20260806 17:01:28.049670 28293 catalog_manager.cc:5495] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffe5d7e13d9442b7bb9e88d529a8e287 (127.7.153.1). New cstate: current_term: 1 leader_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe5d7e13d9442b7bb9e88d529a8e287" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260806 17:01:28.074012 28818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.069391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35348 (local address 127.7.153.1:34319)
0806 17:01:28.069575 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:28.069578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:28.069593 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:01:28.069682 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:28.069684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:28.069740 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:28.069844 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:01:28.070217 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.071124 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.072277 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.072548 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.072682 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.073069 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:01:28.073558 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:01:28.073703 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:28.073772 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 17:01:28.073842 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 17:01:28.082679 28601 raft_consensus.cc:1261] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 1 FOLLOWER]: Refusing update from remote peer ffe5d7e13d9442b7bb9e88d529a8e287: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:28.082732 28750 raft_consensus.cc:1261] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 1 FOLLOWER]: Refusing update from remote peer ffe5d7e13d9442b7bb9e88d529a8e287: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:28.083669 28828 consensus_queue.cc:1035] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03659f5a6dd14787b2dae8c2c66a4d83" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 41265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:28.083947 28832 consensus_queue.cc:1035] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46babe4791894165ad1fa6ba89fda8de" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 43291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:28.094447 28837 mvcc.cc:205] Tried to move back new op lower bound from 7315602178375249920 to 7315602178239967232. Current Snapshot: MvccSnapshot[applied={T|T < 7315602178375249920}]
I20260806 17:01:28.106678 28292 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:28.106909 28292 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:28.109911 28292 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1aede9c1c5447f9be8a041e684ab348: Sending DeleteTablet for 3 replicas of tablet 98393f8273fd4a11860e8b42be0d7bd4
I20260806 17:01:28.110924 28579 tablet_service.cc:1514] Processing DeleteTablet for tablet 98393f8273fd4a11860e8b42be0d7bd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:28 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:37684
I20260806 17:01:28.110999 28430 tablet_service.cc:1514] Processing DeleteTablet for tablet 98393f8273fd4a11860e8b42be0d7bd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:28 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:35338
I20260806 17:01:28.111537 28846 tablet_replica.cc:330] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: stopping tablet replica
I20260806 17:01:28.111521 28728 tablet_service.cc:1514] Processing DeleteTablet for tablet 98393f8273fd4a11860e8b42be0d7bd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:28 UTC) from {username='kudu', principal='kudu/127.7.153.62@KRBTEST.COM'} at 127.0.0.1:36196
I20260806 17:01:28.111954 28846 raft_consensus.cc:2229] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:28.112002 28848 tablet_replica.cc:330] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: stopping tablet replica
I20260806 17:01:28.112372 28846 raft_consensus.cc:2258] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:28.112411 28848 raft_consensus.cc:2229] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:28.112984 28848 raft_consensus.cc:2258] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:28.113037 28847 tablet_replica.cc:330] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287: stopping tablet replica
I20260806 17:01:28.113350 28847 raft_consensus.cc:2229] T 98393f8273fd4a11860e8b42be0d7bd4 P ffe5d7e13d9442b7bb9e88d529a8e287 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:01:28.113515 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28363
I20260806 17:01:28.114190 28846 ts_tablet_manager.cc:1905] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:28.117291 28846 ts_tablet_manager.cc:1918] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:28.117426 28846 log.cc:1196] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/98393f8273fd4a11860e8b42be0d7bd4
I20260806 17:01:28.117573 28848 ts_tablet_manager.cc:1905] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:28.117774 28846 ts_tablet_manager.cc:1939] T 98393f8273fd4a11860e8b42be0d7bd4 P 46babe4791894165ad1fa6ba89fda8de: Deleting consensus metadata
I20260806 17:01:28.119290 28280 catalog_manager.cc:4841] TS 46babe4791894165ad1fa6ba89fda8de (127.7.153.2:43291): tablet 98393f8273fd4a11860e8b42be0d7bd4 (table test-table [id=64937221a6804d68b2af1640ed2c3a68]) successfully deleted
I20260806 17:01:28.120379 28848 ts_tablet_manager.cc:1918] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:28.120474 28848 log.cc:1196] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/98393f8273fd4a11860e8b42be0d7bd4
I20260806 17:01:28.120914 28848 ts_tablet_manager.cc:1939] T 98393f8273fd4a11860e8b42be0d7bd4 P 03659f5a6dd14787b2dae8c2c66a4d83: Deleting consensus metadata
I20260806 17:01:28.122282 28276 catalog_manager.cc:4841] TS 03659f5a6dd14787b2dae8c2c66a4d83 (127.7.153.3:41265): tablet 98393f8273fd4a11860e8b42be0d7bd4 (table test-table [id=64937221a6804d68b2af1640ed2c3a68]) successfully deleted
W20260806 17:01:28.122792 28276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:34319 (error 108)
I20260806 17:01:28.123077 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28508
I20260806 17:01:28.124915 28815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.124493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:34319 (local address 127.0.0.1:35352)
0806 17:01:28.124667 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:28.124788 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:34319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 17:01:28.128909 28276 catalog_manager.cc:4584] TS ffe5d7e13d9442b7bb9e88d529a8e287 (127.7.153.1:34319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 98393f8273fd4a11860e8b42be0d7bd4: Network error: Client connection negotiation failed: client connection to 127.7.153.1:34319: connect: Connection refused (error 111)
I20260806 17:01:28.131577 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28658
I20260806 17:01:28.140501 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28257
2026-08-06T17:01:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2525 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T17:01:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:28Z Disabled control of system clock
I20260806 17:01:28.178013 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37265
--webserver_interface=127.7.153.62
--webserver_port=0
--builtin_ntp_servers=127.7.153.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:37265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 17:01:28.298890 28853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:28.299284 28853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:28.299333 28853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:28.304000 28853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:28.304096 28853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:28.304116 28853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:28.304137 28853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:28.304155 28853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:28.309528 28853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:37265
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:28.310770 28853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:28.312223 28853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:28.321677 28861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:28.321688 28859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:28.321688 28858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:28.321740 28853 server_base.cc:1034] running on GCE node
I20260806 17:01:28.322665 28853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:28.323953 28853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:28.325141 28853 hybrid_clock.cc:648] HybridClock initialized: now 1786035688325114 us; error 52 us; skew 500 ppm
I20260806 17:01:28.332823 28853 webserver.cc:460] Webserver started at http://127.7.153.62:39491/ using document root <none> and password file <none>
I20260806 17:01:28.333559 28853 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:28.333647 28853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:28.333902 28853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:28.336380 28853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "2437b018d5974842872226a59c9693b3"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "e113b2cc3282c88ab6d5bab0a334389e"
server_key_iv: "f28a1aa441ff892558d83a742b875c20"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.337116 28853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "2437b018d5974842872226a59c9693b3"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "e113b2cc3282c88ab6d5bab0a334389e"
server_key_iv: "f28a1aa441ff892558d83a742b875c20"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.341434 28853 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:28.344332 28869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.345873 28853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 17:01:28.346047 28853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "2437b018d5974842872226a59c9693b3"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "e113b2cc3282c88ab6d5bab0a334389e"
server_key_iv: "f28a1aa441ff892558d83a742b875c20"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.346194 28853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:28.359122 28853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:28.359946 28853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:28.360170 28853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:28.368280 28853 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:37265
I20260806 17:01:28.368285 28926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:37265 every 8 connection(s)
I20260806 17:01:28.369458 28853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:28.373160 28927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:28.375979 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28853
I20260806 17:01:28.376129 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:28.376466 7780 external_mini_cluster.cc:1428] Setting key cb3998e618a8e2a09cff909a891e12b4
I20260806 17:01:28.380599 28927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3: Bootstrap starting.
I20260806 17:01:28.383409 28927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:28.384634 28927 log.cc:824] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:28.386982 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.378263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.7.153.62:37265)
0806 17:01:28.379017 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:28.379033 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:28.379086 (+ 53us) server_negotiation.cc:407] Connection header received
0806 17:01:28.379761 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:28.379777 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:28.380204 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:28.380503 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:28.380993 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.382004 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.383221 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.383791 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.383924 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.384950 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:28.384955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:28.384971 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:28.385527 (+ 556us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:28.385613 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:28.385643 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:28.385736 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:28.385909 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 17:01:28.386238 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":164,"threads_started":1}
I20260806 17:01:28.387038 28927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3: No bootstrap required, opened a new log
I20260806 17:01:28.391307 28927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2437b018d5974842872226a59c9693b3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37265 } }
I20260806 17:01:28.391614 28927 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:28.391680 28927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2437b018d5974842872226a59c9693b3, State: Initialized, Role: FOLLOWER
I20260806 17:01:28.392132 28927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2437b018d5974842872226a59c9693b3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37265 } }
I20260806 17:01:28.392287 28927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:28.392356 28927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:28.392485 28927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:28.393627 28927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2437b018d5974842872226a59c9693b3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37265 } }
I20260806 17:01:28.394025 28927 leader_election.cc:302] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2437b018d5974842872226a59c9693b3; no voters:
I20260806 17:01:28.394371 28927 leader_election.cc:288] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:28.394541 28932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:28.394819 28932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [term 1 LEADER]: Becoming Leader. State: Replica: 2437b018d5974842872226a59c9693b3, State: Running, Role: LEADER
I20260806 17:01:28.395139 28932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2437b018d5974842872226a59c9693b3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37265 } }
I20260806 17:01:28.395777 28927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:28.396947 28933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2437b018d5974842872226a59c9693b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2437b018d5974842872226a59c9693b3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37265 } } }
I20260806 17:01:28.397112 28933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:28.397399 28935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2437b018d5974842872226a59c9693b3. Latest consensus state: current_term: 1 leader_uuid: "2437b018d5974842872226a59c9693b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2437b018d5974842872226a59c9693b3" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37265 } } }
I20260806 17:01:28.397493 28935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:28.397811 28943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:28.401563 28943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:28.408488 28943 catalog_manager.cc:1347] Generated new cluster ID: a9c8f60d059e453daec4eb97eef77270
I20260806 17:01:28.408597 28943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:28.424297 28943 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:28.425503 28943 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:28.431155 28943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3: Generated new TSK 0
I20260806 17:01:28.431986 28943 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:28.440423 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.1:0
--local_ip_for_outbound_sockets=127.7.153.1
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37265
--builtin_ntp_servers=127.7.153.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 17:01:28.572240 28953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:28.572597 28953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:28.572640 28953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:28.577320 28953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:28.577416 28953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:28.577477 28953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.1
I20260806 17:01:28.583827 28953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.153.1
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.1
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:28.585199 28953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:28.586712 28953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:28.597378 28964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:28.597407 28962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:28.597378 28961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:28.597704 28953 server_base.cc:1034] running on GCE node
I20260806 17:01:28.598275 28953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:28.599053 28953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:28.600230 28953 hybrid_clock.cc:648] HybridClock initialized: now 1786035688600215 us; error 28 us; skew 500 ppm
I20260806 17:01:28.602355 28953 webserver.cc:460] Webserver started at http://127.7.153.1:34039/ using document root <none> and password file <none>
I20260806 17:01:28.603011 28953 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:28.603080 28953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:28.603349 28953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:28.605737 28953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data/instance:
uuid: "5340854b40104d93818edfa28d91f1fd"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "6f0f0bfaa50964b632a544700aa77501"
server_key_iv: "534f3a29ee14e6718d6c7ea7082b6561"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.606362 28953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance:
uuid: "5340854b40104d93818edfa28d91f1fd"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "6f0f0bfaa50964b632a544700aa77501"
server_key_iv: "534f3a29ee14e6718d6c7ea7082b6561"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.610630 28953 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:28.613929 28971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.615482 28953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 17:01:28.615654 28953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal
uuid: "5340854b40104d93818edfa28d91f1fd"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "6f0f0bfaa50964b632a544700aa77501"
server_key_iv: "534f3a29ee14e6718d6c7ea7082b6561"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.615795 28953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:28.627600 28953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:28.628439 28953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:28.628683 28953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:28.629477 28953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:28.630560 28953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:28.630611 28953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.630654 28953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:28.630694 28953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.640467 28953 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.1:44695
I20260806 17:01:28.640491 29092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.1:44695 every 8 connection(s)
I20260806 17:01:28.641566 28953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/data/info.pb
I20260806 17:01:28.650315 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 28953
I20260806 17:01:28.650470 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-0/wal/instance
I20260806 17:01:28.651259 7780 external_mini_cluster.cc:1428] Setting key 452521d08f234e9c188f6e5a208d5f2b
I20260806 17:01:28.652107 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.643700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.1:44767 (local address 127.7.153.62:37265)
0806 17:01:28.643871 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:28.643876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:28.645150 (+ 1274us) server_negotiation.cc:407] Connection header received
0806 17:01:28.646567 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:28.646570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:28.646624 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:28.646705 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:28.647679 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.648264 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.649625 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.649858 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.650002 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.651500 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:28.651504 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:28.651507 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:28.651523 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:28.651548 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:28.651558 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:28.651640 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:28.651874 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 17:01:28.651956 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 17:01:28.653282 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.644169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:37265 (local address 127.7.153.1:44767)
0806 17:01:28.644982 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:28.645026 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:28.646345 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:28.646890 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:28.646897 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:28.646987 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:28.647528 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.647541 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.648414 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.648417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.649485 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.649497 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.650084 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.650091 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.650363 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.651145 (+ 782us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:28.651147 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:28.651209 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:28.651308 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:28.651667 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:28.651677 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:28.651684 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 17:01:28.651860 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 17:01:28.652211 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":136,"threads_started":1}
I20260806 17:01:28.653627 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.2:0
--local_ip_for_outbound_sockets=127.7.153.2
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37265
--builtin_ntp_servers=127.7.153.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 17:01:28.656477 29093 heartbeater.cc:347] Connected to a master server at 127.7.153.62:37265
I20260806 17:01:28.656838 29093 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:28.657610 29093 heartbeater.cc:511] Master 127.7.153.62:37265 requested a full tablet report, sending...
I20260806 17:01:28.659745 28887 ts_manager.cc:194] Registered new tserver with Master: 5340854b40104d93818edfa28d91f1fd (127.7.153.1:44695)
I20260806 17:01:28.661707 28887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.1:44767
W20260806 17:01:28.778996 29096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:28.779314 29096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:28.779356 29096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:28.783565 29096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:28.783644 29096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:28.783702 29096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.2
I20260806 17:01:28.788659 29096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.153.2
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.2
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:28.789943 29096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:28.791354 29096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:28.802059 29104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:28.801972 29101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:28.802126 29102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:28.802469 29096 server_base.cc:1034] running on GCE node
I20260806 17:01:28.802925 29096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:28.803646 29096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:28.804816 29096 hybrid_clock.cc:648] HybridClock initialized: now 1786035688804797 us; error 27 us; skew 500 ppm
I20260806 17:01:28.806984 29096 webserver.cc:460] Webserver started at http://127.7.153.2:40593/ using document root <none> and password file <none>
I20260806 17:01:28.807682 29096 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:28.807753 29096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:28.807987 29096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:28.810345 29096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data/instance:
uuid: "ba118c5d9726434e99861995784127f3"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "60ae899069f7716fd60f04e97dffc414"
server_key_iv: "da8f3332c915491dee064297283cada1"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.810979 29096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance:
uuid: "ba118c5d9726434e99861995784127f3"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "60ae899069f7716fd60f04e97dffc414"
server_key_iv: "da8f3332c915491dee064297283cada1"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.815286 29096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:28.818295 29111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.820034 29096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 17:01:28.820212 29096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal
uuid: "ba118c5d9726434e99861995784127f3"
format_stamp: "Formatted at 2026-08-06 17:01:28 on dist-test-slave-cbsf"
server_key: "60ae899069f7716fd60f04e97dffc414"
server_key_iv: "da8f3332c915491dee064297283cada1"
server_key_version: "encryptionkey@0"
I20260806 17:01:28.820366 29096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:28.842784 29096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:28.843631 29096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:28.843853 29096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:28.844551 29096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:28.845607 29096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:28.845660 29096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.845701 29096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:28.845743 29096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:28.856163 29096 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.2:44291
I20260806 17:01:28.856178 29237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.2:44291 every 8 connection(s)
I20260806 17:01:28.857272 29096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/data/info.pb
I20260806 17:01:28.863097 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29096
I20260806 17:01:28.863255 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal/instance
I20260806 17:01:28.863605 7780 external_mini_cluster.cc:1428] Setting key 4a84a3ba43dd5b45fc252ec357d5ee3e
I20260806 17:01:28.866113 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.153.3:0
--local_ip_for_outbound_sockets=127.7.153.3
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37265
--builtin_ntp_servers=127.7.153.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 17:01:28.869014 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.859303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:38805 (local address 127.7.153.62:37265)
0806 17:01:28.859470 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:28.859475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:28.860851 (+ 1376us) server_negotiation.cc:407] Connection header received
0806 17:01:28.862375 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:28.862378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:28.862454 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:28.862583 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:28.863972 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.864737 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.866519 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.866760 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.866857 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.868451 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:28.868455 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:28.868457 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:28.868470 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:28.868493 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:28.868501 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:28.868586 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:28.868792 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 17:01:28.868863 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 17:01:28.869999 29240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:28.859906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:37265 (local address 127.7.153.2:38805)
0806 17:01:28.860627 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:28.860676 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:28.862096 (+ 1420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:28.862834 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:28.862846 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:28.862973 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:28.863770 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.863794 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.864881 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.864884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.866370 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:28.866386 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:28.866945 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:28.866952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:28.867209 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:28.868071 (+ 862us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:28.868075 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:28.868146 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:28.868256 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:28.868590 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:28.868602 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:28.868609 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 17:01:28.868780 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 17:01:28.869113 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":132,"threads_started":1}
I20260806 17:01:28.871258 29238 heartbeater.cc:347] Connected to a master server at 127.7.153.62:37265
I20260806 17:01:28.871534 29238 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:28.872128 29238 heartbeater.cc:511] Master 127.7.153.62:37265 requested a full tablet report, sending...
I20260806 17:01:28.873381 28887 ts_manager.cc:194] Registered new tserver with Master: ba118c5d9726434e99861995784127f3 (127.7.153.2:44291)
I20260806 17:01:28.874552 28887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.2:38805
W20260806 17:01:28.989818 29241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:28.990130 29241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:28.990171 29241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:28.996235 29241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:28.996346 29241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:28.996438 29241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.153.3
I20260806 17:01:29.002583 29241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.153.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.153.3
--webserver_port=0
--tserver_master_addrs=127.7.153.62:37265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.153.3
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:29.003875 29241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:29.005492 29241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:29.016047 29249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:29.016076 29247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:29.016345 29241 server_base.cc:1034] running on GCE node
W20260806 17:01:29.016076 29246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:29.017078 29241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:29.017827 29241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:29.019030 29241 hybrid_clock.cc:648] HybridClock initialized: now 1786035689019016 us; error 33 us; skew 500 ppm
I20260806 17:01:29.021308 29241 webserver.cc:460] Webserver started at http://127.7.153.3:43677/ using document root <none> and password file <none>
I20260806 17:01:29.021948 29241 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:29.022048 29241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:29.022298 29241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:29.024654 29241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data/instance:
uuid: "3a78baf480a149aeabb5135c75372990"
format_stamp: "Formatted at 2026-08-06 17:01:29 on dist-test-slave-cbsf"
server_key: "317484f4d56b423062b0859761dfe480"
server_key_iv: "f56539251418565f4799f9b94449189e"
server_key_version: "encryptionkey@0"
I20260806 17:01:29.025345 29241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance:
uuid: "3a78baf480a149aeabb5135c75372990"
format_stamp: "Formatted at 2026-08-06 17:01:29 on dist-test-slave-cbsf"
server_key: "317484f4d56b423062b0859761dfe480"
server_key_iv: "f56539251418565f4799f9b94449189e"
server_key_version: "encryptionkey@0"
I20260806 17:01:29.029454 29241 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:29.032107 29255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:29.033495 29241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 17:01:29.033674 29241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal
uuid: "3a78baf480a149aeabb5135c75372990"
format_stamp: "Formatted at 2026-08-06 17:01:29 on dist-test-slave-cbsf"
server_key: "317484f4d56b423062b0859761dfe480"
server_key_iv: "f56539251418565f4799f9b94449189e"
server_key_version: "encryptionkey@0"
I20260806 17:01:29.033812 29241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:29.055199 29241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:29.055965 29241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:29.056195 29241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:29.056878 29241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 17:01:29.057927 29241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 17:01:29.058002 29241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:29.058079 29241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 17:01:29.058123 29241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:29.067699 29241 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.3:38573
I20260806 17:01:29.067723 29376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.3:38573 every 8 connection(s)
I20260806 17:01:29.068882 29241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/data/info.pb
I20260806 17:01:29.075661 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29241
I20260806 17:01:29.075807 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal/instance
I20260806 17:01:29.076126 7780 external_mini_cluster.cc:1428] Setting key 1b5eaedeff41681a489aafbd4bf5ceaa
I20260806 17:01:29.081029 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.071059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.3:58015 (local address 127.7.153.62:37265)
0806 17:01:29.071231 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.071235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.072461 (+ 1226us) server_negotiation.cc:407] Connection header received
0806 17:01:29.074025 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.074028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.074086 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.074172 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:29.075448 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.076279 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.078296 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.078535 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.078704 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.080451 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:29.080454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:29.080456 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:29.080470 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:29.080492 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:29.080500 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:29.080573 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.080829 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.080901 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 17:01:29.081988 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.071481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:37265 (local address 127.7.153.3:58015)
0806 17:01:29.072258 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.072303 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:29.073755 (+ 1452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:29.074433 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:29.074441 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:29.074538 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:29.075246 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.075272 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.076424 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.076427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.078159 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.078170 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.079003 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.079010 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.079394 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.080126 (+ 732us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 17:01:29.080127 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:29.080176 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 17:01:29.080257 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:29.080592 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:29.080599 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:29.080604 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 17:01:29.080819 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 17:01:29.081106 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":126,"threads_started":1}
I20260806 17:01:29.083317 29377 heartbeater.cc:347] Connected to a master server at 127.7.153.62:37265
I20260806 17:01:29.083557 29377 heartbeater.cc:464] Registering TS with master...
I20260806 17:01:29.084159 29377 heartbeater.cc:511] Master 127.7.153.62:37265 requested a full tablet report, sending...
I20260806 17:01:29.085688 28887 ts_manager.cc:194] Registered new tserver with Master: 3a78baf480a149aeabb5135c75372990 (127.7.153.3:38573)
I20260806 17:01:29.086362 28887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.153.3:58015
I20260806 17:01:29.091305 7780 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 17:01:29.098483 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.093740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46314 (local address 127.7.153.62:37265)
0806 17:01:29.093990 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.093995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.094154 (+ 159us) server_negotiation.cc:407] Connection header received
0806 17:01:29.094547 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.094550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.094616 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.094725 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:29.095044 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.095667 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.096559 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.096910 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.097026 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.097978 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:29.097982 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:29.097985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:29.098000 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:29.098030 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:29.098038 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:29.098126 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.098248 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.098319 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260806 17:01:29.101963 28887 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 17:01:29.105137 28887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 17:01:29.122768 29391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.116595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44695 (local address 127.0.0.1:57150)
0806 17:01:29.117633 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.117707 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:29.117877 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:29.118377 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:29.118383 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:29.118406 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:29.118574 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.118586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.119907 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.119913 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.121247 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.121257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.122153 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.122157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.122273 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.122312 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 17:01:29.122448 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 17:01:29.122599 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"spinlock_wait_cycles":7808,"thread_start_us":135,"threads_started":1}
I20260806 17:01:29.122773 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.116674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57150 (local address 127.7.153.1:44695)
0806 17:01:29.117173 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.117181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.117806 (+ 625us) server_negotiation.cc:407] Connection header received
0806 17:01:29.118036 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.118044 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.118230 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.118359 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:29.118722 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.119770 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.121382 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.122000 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.122149 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.122387 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.122472 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.122587 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":94,"threads_started":1}
I20260806 17:01:29.124203 29388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.117142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:38573 (local address 127.0.0.1:42188)
0806 17:01:29.118095 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.118108 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:29.118185 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:29.118651 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:29.118654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:29.118673 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:29.119039 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.119048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.120572 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.120576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.122103 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.122116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.123748 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.123752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.123887 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.123909 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 17:01:29.123984 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 17:01:29.124058 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"mutex_wait_us":146,"thread_start_us":91,"threads_started":1}
I20260806 17:01:29.124423 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.117571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42188 (local address 127.7.153.3:38573)
0806 17:01:29.118151 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.118165 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.118189 (+ 24us) server_negotiation.cc:407] Connection header received
0806 17:01:29.118304 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.118309 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.118495 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.118654 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:29.119171 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.120443 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.122260 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.123428 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.123525 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.123693 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.124091 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.124208 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":171,"threads_started":1}
I20260806 17:01:29.124958 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.116883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.2:44291 (local address 127.0.0.1:42766)
0806 17:01:29.117694 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.117710 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:29.117877 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:29.118957 (+ 1080us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:29.118960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:29.118979 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:29.119134 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.119143 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.120572 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.120576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.122110 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.122117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.123666 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.123670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.123779 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.123803 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 17:01:29.124733 (+ 930us) client_negotiation.cc:240] Negotiation successful
0806 17:01:29.124820 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"mutex_wait_us":204,"spinlock_wait_cycles":12416,"thread_start_us":100,"threads_started":1}
I20260806 17:01:29.125196 29393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.117457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42766 (local address 127.7.153.2:44291)
0806 17:01:29.118505 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.118516 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.118533 (+ 17us) server_negotiation.cc:407] Connection header received
0806 17:01:29.118632 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.118636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.118808 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.118952 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:29.119239 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.120434 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.122260 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.123275 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.123392 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.123593 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.124772 (+ 1179us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.124882 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":158,"threads_started":1}
I20260806 17:01:29.126487 29020 tablet_service.cc:1467] Processing CreateTablet for tablet 9eb0c69d177c484a8c56405cbf90dca6 (DEFAULT_TABLE table=test-table [id=d9f20e583a7b4ddfafac6bfb2b47a391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:29.127627 29020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eb0c69d177c484a8c56405cbf90dca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:29.127343 29306 tablet_service.cc:1467] Processing CreateTablet for tablet 9eb0c69d177c484a8c56405cbf90dca6 (DEFAULT_TABLE table=test-table [id=d9f20e583a7b4ddfafac6bfb2b47a391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:29.127833 29163 tablet_service.cc:1467] Processing CreateTablet for tablet 9eb0c69d177c484a8c56405cbf90dca6 (DEFAULT_TABLE table=test-table [id=d9f20e583a7b4ddfafac6bfb2b47a391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 17:01:29.128427 29306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eb0c69d177c484a8c56405cbf90dca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:29.128966 29163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eb0c69d177c484a8c56405cbf90dca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:29.134722 29395 tablet_bootstrap.cc:492] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: Bootstrap starting.
I20260806 17:01:29.136641 29396 tablet_bootstrap.cc:492] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Bootstrap starting.
I20260806 17:01:29.136641 29397 tablet_bootstrap.cc:492] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Bootstrap starting.
I20260806 17:01:29.137537 29395 tablet_bootstrap.cc:654] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:29.138513 29395 log.cc:824] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:29.139146 29397 tablet_bootstrap.cc:654] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:29.139158 29396 tablet_bootstrap.cc:654] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:29.140060 29396 log.cc:824] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:29.140060 29397 log.cc:824] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:29.141434 29395 tablet_bootstrap.cc:492] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: No bootstrap required, opened a new log
I20260806 17:01:29.141669 29395 ts_tablet_manager.cc:1397] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 17:01:29.142414 29397 tablet_bootstrap.cc:492] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: No bootstrap required, opened a new log
I20260806 17:01:29.142620 29397 ts_tablet_manager.cc:1397] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 17:01:29.142910 29396 tablet_bootstrap.cc:492] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: No bootstrap required, opened a new log
I20260806 17:01:29.143128 29396 ts_tablet_manager.cc:1397] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 17:01:29.146440 29396 raft_consensus.cc:348] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.146481 29395 raft_consensus.cc:348] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.146760 29396 raft_consensus.cc:374] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:29.146772 29395 raft_consensus.cc:374] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:29.146821 29396 raft_consensus.cc:729] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba118c5d9726434e99861995784127f3, State: Initialized, Role: FOLLOWER
I20260806 17:01:29.146824 29395 raft_consensus.cc:729] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5340854b40104d93818edfa28d91f1fd, State: Initialized, Role: FOLLOWER
I20260806 17:01:29.146988 29397 raft_consensus.cc:348] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.147254 29397 raft_consensus.cc:374] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:29.147312 29397 raft_consensus.cc:729] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a78baf480a149aeabb5135c75372990, State: Initialized, Role: FOLLOWER
I20260806 17:01:29.147405 29395 consensus_queue.cc:260] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.147771 29397 consensus_queue.cc:260] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.148342 29093 heartbeater.cc:503] Master 127.7.153.62:37265 was elected leader, sending a full tablet report...
I20260806 17:01:29.148667 29395 ts_tablet_manager.cc:1428] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 17:01:29.148667 29397 ts_tablet_manager.cc:1428] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 17:01:29.148663 29396 consensus_queue.cc:260] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.149084 29377 heartbeater.cc:503] Master 127.7.153.62:37265 was elected leader, sending a full tablet report...
I20260806 17:01:29.149430 29238 heartbeater.cc:503] Master 127.7.153.62:37265 was elected leader, sending a full tablet report...
I20260806 17:01:29.149682 29396 ts_tablet_manager.cc:1428] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260806 17:01:29.222087 29404 raft_consensus.cc:482] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 17:01:29.222373 29404 raft_consensus.cc:504] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.223660 29404 leader_election.cc:288] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5340854b40104d93818edfa28d91f1fd (127.7.153.1:44695), 3a78baf480a149aeabb5135c75372990 (127.7.153.3:38573)
I20260806 17:01:29.227763 29240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.223963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.3:38573 (local address 127.7.153.2:57033)
0806 17:01:29.224267 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.224284 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:29.224438 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:29.224746 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:29.224749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:29.224766 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:29.224893 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.224900 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.225776 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.225781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.226599 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.226609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.227286 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.227289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.227393 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.227416 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 17:01:29.227517 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 17:01:29.227596 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223}
I20260806 17:01:29.227746 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.224103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:57033 (local address 127.7.153.3:38573)
0806 17:01:29.224270 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.224277 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.224367 (+ 90us) server_negotiation.cc:407] Connection header received
0806 17:01:29.224561 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.224567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.224616 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.224734 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:29.225012 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.225662 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.226734 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.227152 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.227276 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.227343 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.227535 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.227608 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 17:01:29.227811 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.224126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.153.2:49527 (local address 127.7.153.1:44695)
0806 17:01:29.224293 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.224300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.224573 (+ 273us) server_negotiation.cc:407] Connection header received
0806 17:01:29.224775 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.224778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.224823 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.224914 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 17:01:29.225190 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.225775 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.226812 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.227221 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.227341 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.227403 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.227610 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.227685 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 17:01:29.227825 29405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.223982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44695 (local address 127.7.153.2:49527)
0806 17:01:29.224472 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.224484 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:29.224622 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:29.224923 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:29.224926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:29.224942 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 17:01:29.225076 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.225082 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.225886 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.225893 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.226677 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:29.226686 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.227346 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.227350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:29.227453 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.227475 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 17:01:29.227588 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 17:01:29.227660 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":16,"thread_start_us":141,"threads_started":1}
I20260806 17:01:29.228503 29044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eb0c69d177c484a8c56405cbf90dca6" candidate_uuid: "ba118c5d9726434e99861995784127f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5340854b40104d93818edfa28d91f1fd" is_pre_election: true
I20260806 17:01:29.228593 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eb0c69d177c484a8c56405cbf90dca6" candidate_uuid: "ba118c5d9726434e99861995784127f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a78baf480a149aeabb5135c75372990" is_pre_election: true
I20260806 17:01:29.228899 29044 raft_consensus.cc:2454] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba118c5d9726434e99861995784127f3 in term 0.
I20260806 17:01:29.228920 29326 raft_consensus.cc:2454] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba118c5d9726434e99861995784127f3 in term 0.
I20260806 17:01:29.229446 29112 leader_election.cc:302] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3a78baf480a149aeabb5135c75372990, 5340854b40104d93818edfa28d91f1fd, ba118c5d9726434e99861995784127f3; no voters:
I20260806 17:01:29.229785 29404 raft_consensus.cc:2781] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 17:01:29.229882 29404 raft_consensus.cc:482] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 17:01:29.229925 29404 raft_consensus.cc:3037] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:29.230995 29404 raft_consensus.cc:504] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.231395 29404 leader_election.cc:288] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [CANDIDATE]: Term 1 election: Requested vote from peers 5340854b40104d93818edfa28d91f1fd (127.7.153.1:44695), 3a78baf480a149aeabb5135c75372990 (127.7.153.3:38573)
I20260806 17:01:29.231791 29044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eb0c69d177c484a8c56405cbf90dca6" candidate_uuid: "ba118c5d9726434e99861995784127f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5340854b40104d93818edfa28d91f1fd"
I20260806 17:01:29.231899 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eb0c69d177c484a8c56405cbf90dca6" candidate_uuid: "ba118c5d9726434e99861995784127f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a78baf480a149aeabb5135c75372990"
I20260806 17:01:29.231973 29044 raft_consensus.cc:3037] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:29.232056 29326 raft_consensus.cc:3037] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:29.233212 29326 raft_consensus.cc:2454] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba118c5d9726434e99861995784127f3 in term 1.
I20260806 17:01:29.233225 29044 raft_consensus.cc:2454] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba118c5d9726434e99861995784127f3 in term 1.
I20260806 17:01:29.233613 29112 leader_election.cc:302] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5340854b40104d93818edfa28d91f1fd, ba118c5d9726434e99861995784127f3; no voters:
I20260806 17:01:29.233865 29404 raft_consensus.cc:2781] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:29.234140 29404 raft_consensus.cc:686] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 1 LEADER]: Becoming Leader. State: Replica: ba118c5d9726434e99861995784127f3, State: Running, Role: LEADER
I20260806 17:01:29.234501 29404 consensus_queue.cc:237] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } }
I20260806 17:01:29.238116 28886 catalog_manager.cc:5495] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba118c5d9726434e99861995784127f3 (127.7.153.2). New cstate: current_term: 1 leader_uuid: "ba118c5d9726434e99861995784127f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba118c5d9726434e99861995784127f3" member_type: VOTER last_known_addr { host: "127.7.153.2" port: 44291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 } health_report { overall_health: UNKNOWN } } }
I20260806 17:01:29.280562 29393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.276668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42782 (local address 127.7.153.2:44291)
0806 17:01:29.276834 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:29.276841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:29.276858 (+ 17us) server_negotiation.cc:407] Connection header received
0806 17:01:29.276955 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:29.276957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:29.277016 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:29.277142 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:01:29.277428 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.277951 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.278865 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:29.279091 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:29.279214 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:29.279565 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:01:29.280085 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:01:29.280248 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:29.280286 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 17:01:29.280351 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 17:01:29.287734 29044 raft_consensus.cc:1261] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd [term 1 FOLLOWER]: Refusing update from remote peer ba118c5d9726434e99861995784127f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:29.287734 29326 raft_consensus.cc:1261] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 1 FOLLOWER]: Refusing update from remote peer ba118c5d9726434e99861995784127f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:29.288648 29406 consensus_queue.cc:1035] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5340854b40104d93818edfa28d91f1fd" member_type: VOTER last_known_addr { host: "127.7.153.1" port: 44695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:29.288937 29404 consensus_queue.cc:1035] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a78baf480a149aeabb5135c75372990" member_type: VOTER last_known_addr { host: "127.7.153.3" port: 38573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:29.306833 28885 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:29.307065 28885 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 17:01:29.310333 28885 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2437b018d5974842872226a59c9693b3: Sending DeleteTablet for 3 replicas of tablet 9eb0c69d177c484a8c56405cbf90dca6
I20260806 17:01:29.311297 29163 tablet_service.cc:1514] Processing DeleteTablet for tablet 9eb0c69d177c484a8c56405cbf90dca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:29 UTC) from {username='slave'} at 127.0.0.1:42766
I20260806 17:01:29.311297 29306 tablet_service.cc:1514] Processing DeleteTablet for tablet 9eb0c69d177c484a8c56405cbf90dca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260806 17:01:29.311946 29421 tablet_replica.cc:330] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: stopping tablet replica
I20260806 17:01:29.311923 29020 tablet_service.cc:1514] Processing DeleteTablet for tablet 9eb0c69d177c484a8c56405cbf90dca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 17:01:29 UTC) from {username='slave'} at 127.0.0.1:57150
I20260806 17:01:29.312438 29421 raft_consensus.cc:2229] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 17:01:29.312534 29423 tablet_replica.cc:330] T 9eb0c69d177c484a8c56405cbf90dca6 P 5340854b40104d93818edfa28d91f1fd: stopping tablet replica
I20260806 17:01:29.312922 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28953
I20260806 17:01:29.315443 29421 raft_consensus.cc:2258] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:29.316046 29422 tablet_replica.cc:330] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: stopping tablet replica
I20260806 17:01:29.316494 29422 raft_consensus.cc:2229] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 17:01:29.317073 29422 raft_consensus.cc:2258] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 17:01:29.323181 29422 ts_tablet_manager.cc:1905] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:29.324308 29421 ts_tablet_manager.cc:1905] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 17:01:29.327090 29421 ts_tablet_manager.cc:1918] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:29.327090 29422 ts_tablet_manager.cc:1918] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 17:01:29.327207 29421 log.cc:1196] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-2/wal/wals/9eb0c69d177c484a8c56405cbf90dca6
I20260806 17:01:29.327212 29422 log.cc:1196] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Deleting WAL directory at /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786035416626244-7780-0/minicluster-data/ts-1/wal/wals/9eb0c69d177c484a8c56405cbf90dca6
I20260806 17:01:29.327543 29421 ts_tablet_manager.cc:1939] T 9eb0c69d177c484a8c56405cbf90dca6 P 3a78baf480a149aeabb5135c75372990: Deleting consensus metadata
I20260806 17:01:29.327570 29422 ts_tablet_manager.cc:1939] T 9eb0c69d177c484a8c56405cbf90dca6 P ba118c5d9726434e99861995784127f3: Deleting consensus metadata
I20260806 17:01:29.329334 28873 catalog_manager.cc:4841] TS ba118c5d9726434e99861995784127f3 (127.7.153.2:44291): tablet 9eb0c69d177c484a8c56405cbf90dca6 (table test-table [id=d9f20e583a7b4ddfafac6bfb2b47a391]) successfully deleted
W20260806 17:01:29.329577 28870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.153.1:44695 (error 108)
I20260806 17:01:29.330093 28871 catalog_manager.cc:4841] TS 3a78baf480a149aeabb5135c75372990 (127.7.153.3:38573): tablet 9eb0c69d177c484a8c56405cbf90dca6 (table test-table [id=d9f20e583a7b4ddfafac6bfb2b47a391]) successfully deleted
I20260806 17:01:29.330756 29390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:29.330424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.1:44695 (local address 127.0.0.1:57154)
0806 17:01:29.330565 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:29.330649 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.1:44695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 17:01:29.330907 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29096
W20260806 17:01:29.330996 28870 catalog_manager.cc:4584] TS 5340854b40104d93818edfa28d91f1fd (127.7.153.1:44695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9eb0c69d177c484a8c56405cbf90dca6: Network error: Client connection negotiation failed: client connection to 127.7.153.1:44695: connect: Connection refused (error 111)
I20260806 17:01:29.341024 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29241
I20260806 17:01:29.350195 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 28853
2026-08-06T17:01:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1209 ms)
[----------] 6 tests from EncryptionPolicyTest (11468 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:29 dist-test-slave-cbsf krb5kdc[29428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:29 dist-test-slave-cbsf krb5kdc[29428](info): set up 2 sockets
Aug 06 17:01:29 dist-test-slave-cbsf krb5kdc[29428](info): commencing operation
krb5kdc: starting...
W20260806 17:01:30.467718 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:30 dist-test-slave-cbsf krb5kdc[29428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:30.625847 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38949
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:30.759378 29442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:30.759796 29442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:30.759889 29442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:30.765172 29442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:30.765317 29442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:30.765359 29442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:30.765403 29442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:30.765436 29442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:30.772032 29442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38949
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:30.773413 29442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:30.774612 29442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:30.784390 29452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:30.784407 29450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:30.784368 29449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:30.784801 29442 server_base.cc:1034] running on GCE node
I20260806 17:01:30.785523 29442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:30.786865 29442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:30.788084 29442 hybrid_clock.cc:648] HybridClock initialized: now 1786035690788043 us; error 65 us; skew 500 ppm
Aug 06 17:01:30 dist-test-slave-cbsf krb5kdc[29428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035690, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:30.791440 29442 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:30.792645 29442 webserver.cc:460] Webserver started at http://127.0.0.1:40777/ using document root <none> and password file <none>
I20260806 17:01:30.793345 29442 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:30.793450 29442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:30.793745 29442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:30.796970 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "51907fb930f444728294e6d96587b941"
format_stamp: "Formatted at 2026-08-06 17:01:30 on dist-test-slave-cbsf"
server_key: "501c023425dad310537ce2be7599ee0b"
server_key_iv: "66514b3c7360d49066dc93effa3e6ad8"
server_key_version: "encryptionkey@0"
I20260806 17:01:30.797812 29442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "51907fb930f444728294e6d96587b941"
format_stamp: "Formatted at 2026-08-06 17:01:30 on dist-test-slave-cbsf"
server_key: "501c023425dad310537ce2be7599ee0b"
server_key_iv: "66514b3c7360d49066dc93effa3e6ad8"
server_key_version: "encryptionkey@0"
I20260806 17:01:30.802968 29442 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 17:01:30.806360 29460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:30.808614 29442 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 17:01:30.809098 29442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "51907fb930f444728294e6d96587b941"
format_stamp: "Formatted at 2026-08-06 17:01:30 on dist-test-slave-cbsf"
server_key: "501c023425dad310537ce2be7599ee0b"
server_key_iv: "66514b3c7360d49066dc93effa3e6ad8"
server_key_version: "encryptionkey@0"
I20260806 17:01:30.809370 29442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:30.848061 29442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:30.851897 29442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:30.852149 29442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:30.861497 29442 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38949
I20260806 17:01:30.861526 29520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38949 every 8 connection(s)
I20260806 17:01:30.862725 29442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:30.867084 29521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:30.867614 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29442
I20260806 17:01:30.867781 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:30.868352 7780 external_mini_cluster.cc:1428] Setting key 7a36281e0ff0f93a7956c8945fb3c421
I20260806 17:01:30.875897 29521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941: Bootstrap starting.
I20260806 17:01:30.878861 29521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941: Neither blocks nor log segments found. Creating new log.
Aug 06 17:01:30 dist-test-slave-cbsf krb5kdc[29428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 17:01:30.879941 29521 log.cc:824] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:30.882629 29521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941: No bootstrap required, opened a new log
I20260806 17:01:30.885778 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:30.870366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48879 (local address 127.0.0.1:38949)
0806 17:01:30.870962 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:30.870981 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:30.871023 (+ 42us) server_negotiation.cc:407] Connection header received
0806 17:01:30.871797 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:30.871820 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:30.872250 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:30.872838 (+ 588us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:30.874114 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:30.875208 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:30.876289 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:30.876990 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:30.877200 (+ 210us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:30.880315 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:30.880323 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:30.880347 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:30.880393 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:30.882312 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:30.883048 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:30.883054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:30.883059 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:30.883199 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:30.883594 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:30.883597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:30.883598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:30.884052 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:30.884234 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:30.884580 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 17:01:30.884921 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":203,"threads_started":1}
I20260806 17:01:30.887210 29521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51907fb930f444728294e6d96587b941" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38949 } }
I20260806 17:01:30.887521 29521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:30.887573 29521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51907fb930f444728294e6d96587b941, State: Initialized, Role: FOLLOWER
I20260806 17:01:30.888101 29521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51907fb930f444728294e6d96587b941" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38949 } }
I20260806 17:01:30.888280 29521 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:30.888383 29521 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:30.888513 29521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:30.889433 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:30.889933 29521 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51907fb930f444728294e6d96587b941" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38949 } }
I20260806 17:01:30.890342 29521 leader_election.cc:302] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51907fb930f444728294e6d96587b941; no voters:
I20260806 17:01:30.890767 29521 leader_election.cc:288] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:30.890857 29527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:30.891058 29527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [term 1 LEADER]: Becoming Leader. State: Replica: 51907fb930f444728294e6d96587b941, State: Running, Role: LEADER
I20260806 17:01:30.891395 29527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51907fb930f444728294e6d96587b941" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38949 } }
I20260806 17:01:30.892302 29521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:30.892757 29527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51907fb930f444728294e6d96587b941" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51907fb930f444728294e6d96587b941" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38949 } } }
I20260806 17:01:30.892897 29527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:30.893108 29527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51907fb930f444728294e6d96587b941. Latest consensus state: current_term: 1 leader_uuid: "51907fb930f444728294e6d96587b941" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51907fb930f444728294e6d96587b941" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38949 } } }
I20260806 17:01:30.893216 29527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:30.893519 29536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:30.897369 29536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:30.902460 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:30.891934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52537 (local address 127.0.0.1:38949)
0806 17:01:30.892063 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:30.892068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:30.892309 (+ 241us) server_negotiation.cc:407] Connection header received
0806 17:01:30.892488 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:30.892491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:30.892572 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:30.892661 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:30.894010 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:30.894795 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:30.896032 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:30.896287 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:30.896415 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:30.898529 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:30.898532 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:30.898536 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:30.898567 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:30.900317 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:30.900965 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:30.900969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:30.900971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:30.901070 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:30.901445 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:30.901448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:30.901450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:30.901669 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:30.901850 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:30.902164 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 17:01:30.902272 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 17:01:30.906154 29536 catalog_manager.cc:1347] Generated new cluster ID: 366eee579bf14ea296551a137f1fcb02
I20260806 17:01:30.906262 29536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:30.930493 29536 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:30.931551 29536 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:30.941155 29536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51907fb930f444728294e6d96587b941: Generated new TSK 0
I20260806 17:01:30.942227 29536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:30.956862 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29442
W20260806 17:01:30.964514 29425 connection.cc:535] client connection to 127.0.0.1:38949 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38949): Connection reset by peer (error 104)
2026-08-06T17:01:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1603 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:31 dist-test-slave-cbsf krb5kdc[29554](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:31 dist-test-slave-cbsf krb5kdc[29554](info): set up 2 sockets
Aug 06 17:01:31 dist-test-slave-cbsf krb5kdc[29554](info): commencing operation
krb5kdc: starting...
W20260806 17:01:32.067996 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.003s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:32 dist-test-slave-cbsf krb5kdc[29554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:32.220854 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:32.345481 29568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:32.345880 29568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:32.345963 29568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:32.350440 29568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:32.350528 29568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:32.350549 29568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:32.350567 29568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:32.350582 29568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:32.356442 29568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44297
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:32.357760 29568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:32.358841 29568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:32.368469 29576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:32.368532 29568 server_base.cc:1034] running on GCE node
W20260806 17:01:32.368471 29574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:32.368471 29573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:32.369477 29568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:32.370950 29568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:32.372228 29568 hybrid_clock.cc:648] HybridClock initialized: now 1786035692372131 us; error 113 us; skew 500 ppm
Aug 06 17:01:32 dist-test-slave-cbsf krb5kdc[29554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035692, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:32.376117 29568 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:32.377369 29568 webserver.cc:460] Webserver started at http://127.0.0.1:44147/ using document root <none> and password file <none>
I20260806 17:01:32.377970 29568 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:32.378033 29568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:32.378228 29568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:32.380507 29568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2"
format_stamp: "Formatted at 2026-08-06 17:01:32 on dist-test-slave-cbsf"
server_key: "1fe4b50d05f45cc16b38668ccc751f45"
server_key_iv: "679269f0ba54544edbf5b862cb9d0a07"
server_key_version: "encryptionkey@0"
I20260806 17:01:32.381191 29568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2"
format_stamp: "Formatted at 2026-08-06 17:01:32 on dist-test-slave-cbsf"
server_key: "1fe4b50d05f45cc16b38668ccc751f45"
server_key_iv: "679269f0ba54544edbf5b862cb9d0a07"
server_key_version: "encryptionkey@0"
I20260806 17:01:32.385672 29568 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:32.388615 29583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:32.390164 29568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 17:01:32.390350 29568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2"
format_stamp: "Formatted at 2026-08-06 17:01:32 on dist-test-slave-cbsf"
server_key: "1fe4b50d05f45cc16b38668ccc751f45"
server_key_iv: "679269f0ba54544edbf5b862cb9d0a07"
server_key_version: "encryptionkey@0"
I20260806 17:01:32.390497 29568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:32.401557 29568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:32.406364 29568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:32.406654 29568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:32.414913 29568 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44297
I20260806 17:01:32.414953 29640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44297 every 8 connection(s)
I20260806 17:01:32.416021 29568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:32.419478 29642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:32.420082 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29568
I20260806 17:01:32.420236 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:32.420588 7780 external_mini_cluster.cc:1428] Setting key 35ce9f272fde76eb41124ca6e65f356f
I20260806 17:01:32.426756 29642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2: Bootstrap starting.
I20260806 17:01:32.430621 29642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:32.431588 29642 log.cc:824] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:32.432174 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:32.422199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40811 (local address 127.0.0.1:44297)
0806 17:01:32.422702 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:32.422730 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:32.422769 (+ 39us) server_negotiation.cc:407] Connection header received
0806 17:01:32.423477 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:32.423497 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:32.423874 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:32.424201 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:32.424663 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:32.425766 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:32.427042 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:32.427588 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:32.427725 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:32.429589 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:32.429597 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:32.429622 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:32.430323 (+ 701us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:32.430423 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:32.430462 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:32.430630 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:32.431019 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 17:01:32.431209 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":170,"threads_started":1}
I20260806 17:01:32.434013 29642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2: No bootstrap required, opened a new log
I20260806 17:01:32.435750 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:32.439422 29642 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44297 } }
I20260806 17:01:32.439751 29642 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:32.439812 29642 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2f4e7fb4d54c69aaaa535d63fecbe2, State: Initialized, Role: FOLLOWER
I20260806 17:01:32.440353 29642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44297 } }
I20260806 17:01:32.440537 29642 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:32.440626 29642 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:32.440762 29642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:32.442121 29642 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44297 } }
I20260806 17:01:32.442526 29642 leader_election.cc:302] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c2f4e7fb4d54c69aaaa535d63fecbe2; no voters:
I20260806 17:01:32.442924 29642 leader_election.cc:288] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:32.443080 29652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:32.443218 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:32.438552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48585 (local address 127.0.0.1:44297)
0806 17:01:32.438714 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:32.438718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:32.438835 (+ 117us) server_negotiation.cc:407] Connection header received
0806 17:01:32.438971 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:32.438974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:32.439019 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:32.439090 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:32.439408 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:32.440070 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:32.441278 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:32.441532 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:32.441631 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:32.442626 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:32.442631 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:32.442634 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:32.442651 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:32.442706 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:32.442727 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:32.442834 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:32.442959 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 17:01:32.442997 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 17:01:32.443399 29652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [term 1 LEADER]: Becoming Leader. State: Replica: 1c2f4e7fb4d54c69aaaa535d63fecbe2, State: Running, Role: LEADER
I20260806 17:01:32.443724 29652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44297 } }
I20260806 17:01:32.444427 29642 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:32.445161 29653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c2f4e7fb4d54c69aaaa535d63fecbe2. Latest consensus state: current_term: 1 leader_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44297 } } }
I20260806 17:01:32.445317 29653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:32.445580 29654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c2f4e7fb4d54c69aaaa535d63fecbe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44297 } } }
I20260806 17:01:32.445683 29654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:32.445720 29661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:32.449057 29661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:32.457410 29661 catalog_manager.cc:1347] Generated new cluster ID: 1881301879fc46049a08d80ff9ee3af8
I20260806 17:01:32.457528 29661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:32.480325 29661 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:32.481876 29661 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:32.497164 29661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c2f4e7fb4d54c69aaaa535d63fecbe2: Generated new TSK 0
I20260806 17:01:32.498045 29661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:32.502249 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29568
W20260806 17:01:32.511343 29552 connection.cc:535] client connection to 127.0.0.1:44297 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44297): Connection reset by peer (error 104)
2026-08-06T17:01:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:32 dist-test-slave-cbsf krb5kdc[29675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:32 dist-test-slave-cbsf krb5kdc[29675](info): set up 2 sockets
Aug 06 17:01:32 dist-test-slave-cbsf krb5kdc[29675](info): commencing operation
krb5kdc: starting...
W20260806 17:01:33.612476 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:33 dist-test-slave-cbsf krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:33.753170 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44525
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:33.878998 29688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:33.879320 29688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:33.879365 29688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:33.883677 29688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:33.883764 29688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:33.883783 29688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:33.883800 29688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:33.883816 29688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:33.889678 29688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44525
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:33.890873 29688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:33.892019 29688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:33.901368 29694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:33.901420 29695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:33.901368 29697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:33.901576 29688 server_base.cc:1034] running on GCE node
I20260806 17:01:33.902446 29688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:33.903781 29688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:33.904953 29688 hybrid_clock.cc:648] HybridClock initialized: now 1786035693904937 us; error 39 us; skew 500 ppm
Aug 06 17:01:33 dist-test-slave-cbsf krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035693, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:33.917443 29688 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:33.918601 29688 webserver.cc:460] Webserver started at http://127.0.0.1:43323/ using document root <none> and password file <none>
I20260806 17:01:33.919236 29688 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:33.919307 29688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:33.919584 29688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:33.921926 29688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "08b2364b0287411489940cdf21eb2cf0"
format_stamp: "Formatted at 2026-08-06 17:01:33 on dist-test-slave-cbsf"
server_key: "5d90ba36598f3e9e3298644c9c6ff2dc"
server_key_iv: "be9d2b118c4526ba5a39c0b5143aed39"
server_key_version: "encryptionkey@0"
I20260806 17:01:33.922580 29688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "08b2364b0287411489940cdf21eb2cf0"
format_stamp: "Formatted at 2026-08-06 17:01:33 on dist-test-slave-cbsf"
server_key: "5d90ba36598f3e9e3298644c9c6ff2dc"
server_key_iv: "be9d2b118c4526ba5a39c0b5143aed39"
server_key_version: "encryptionkey@0"
I20260806 17:01:33.926956 29688 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:33.929719 29706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:33.931085 29688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 17:01:33.931231 29688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "08b2364b0287411489940cdf21eb2cf0"
format_stamp: "Formatted at 2026-08-06 17:01:33 on dist-test-slave-cbsf"
server_key: "5d90ba36598f3e9e3298644c9c6ff2dc"
server_key_iv: "be9d2b118c4526ba5a39c0b5143aed39"
server_key_version: "encryptionkey@0"
I20260806 17:01:33.931351 29688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:33.936372 29688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:33.940004 29688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:33.940263 29688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:33.948108 29688 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44525
I20260806 17:01:33.948118 29764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44525 every 8 connection(s)
I20260806 17:01:33.949234 29688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:33.952360 29765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:33.953100 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29688
I20260806 17:01:33.953262 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:33.953589 7780 external_mini_cluster.cc:1428] Setting key 77ba901c73a514b418b24e66b645d8f6
I20260806 17:01:33.959421 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:33.955153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33317 (local address 127.0.0.1:44525)
0806 17:01:33.955676 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:33.955693 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:33.955733 (+ 40us) server_negotiation.cc:407] Connection header received
0806 17:01:33.956445 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:33.956464 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:33.956855 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:33.957249 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:33.958097 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:33.958102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:33.958116 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:33.958128 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:33.958192 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:33.958213 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:33.958379 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:33.958452 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 17:01:33.958627 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":157,"threads_started":1}
I20260806 17:01:33.960240 29765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0: Bootstrap starting.
I20260806 17:01:33.962852 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:33.963260 29765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:33.964087 29765 log.cc:824] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:33.966976 29765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0: No bootstrap required, opened a new log
I20260806 17:01:33.967079 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:33.965252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34777 (local address 127.0.0.1:44525)
0806 17:01:33.965394 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:33.965399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:33.965560 (+ 161us) server_negotiation.cc:407] Connection header received
0806 17:01:33.965680 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:33.965683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:33.965721 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:33.965815 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:33.966559 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:33.966563 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:33.966568 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:33.966584 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:33.966615 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:33.966629 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:33.966738 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:33.966868 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 17:01:33.966910 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 17:01:33.970942 29765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2364b0287411489940cdf21eb2cf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260806 17:01:33.971237 29765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:33.971275 29765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b2364b0287411489940cdf21eb2cf0, State: Initialized, Role: FOLLOWER
I20260806 17:01:33.971829 29765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2364b0287411489940cdf21eb2cf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260806 17:01:33.971987 29765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:33.972061 29765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:33.972193 29765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:33.973413 29765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2364b0287411489940cdf21eb2cf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260806 17:01:33.973822 29765 leader_election.cc:302] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08b2364b0287411489940cdf21eb2cf0; no voters:
I20260806 17:01:33.974238 29765 leader_election.cc:288] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:33.974550 29776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:33.974831 29776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 08b2364b0287411489940cdf21eb2cf0, State: Running, Role: LEADER
I20260806 17:01:33.975206 29776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2364b0287411489940cdf21eb2cf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } }
I20260806 17:01:33.975752 29765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:33.977548 29778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08b2364b0287411489940cdf21eb2cf0. Latest consensus state: current_term: 1 leader_uuid: "08b2364b0287411489940cdf21eb2cf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2364b0287411489940cdf21eb2cf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } } }
I20260806 17:01:33.977566 29777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08b2364b0287411489940cdf21eb2cf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b2364b0287411489940cdf21eb2cf0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44525 } } }
I20260806 17:01:33.977721 29778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:33.977720 29777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:33.978181 29789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:33.981608 29789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:33.988826 29789 catalog_manager.cc:1347] Generated new cluster ID: 9d3e8d388a484d6f87a9a1eee49df9ed
I20260806 17:01:33.988931 29789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:34.000386 29789 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:34.000833 29789 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:34.008442 29789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08b2364b0287411489940cdf21eb2cf0: Generated new TSK 0
I20260806 17:01:34.009351 29789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:34.020107 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29688
2026-08-06T17:01:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1518 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:34 dist-test-slave-cbsf krb5kdc[29799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:34 dist-test-slave-cbsf krb5kdc[29799](info): set up 2 sockets
Aug 06 17:01:34 dist-test-slave-cbsf krb5kdc[29799](info): commencing operation
krb5kdc: starting...
W20260806 17:01:35.115899 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.007s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:35 dist-test-slave-cbsf krb5kdc[29799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:35.265024 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37389
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:35.393878 29814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:35.394236 29814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:35.394284 29814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:35.398676 29814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:35.398773 29814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:35.398795 29814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:35.398813 29814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:35.398829 29814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:35.405292 29814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:35.406613 29814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:35.407775 29814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:35.417706 29820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:35.417994 29814 server_base.cc:1034] running on GCE node
W20260806 17:01:35.417709 29821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:35.417709 29823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:35.418892 29814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:35.420131 29814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:35.421329 29814 hybrid_clock.cc:648] HybridClock initialized: now 1786035695421304 us; error 40 us; skew 500 ppm
Aug 06 17:01:35 dist-test-slave-cbsf krb5kdc[29799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:35.425645 29814 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:35.426808 29814 webserver.cc:460] Webserver started at http://127.0.0.1:43059/ using document root <none> and password file <none>
I20260806 17:01:35.427522 29814 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:35.427644 29814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:35.427960 29814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:35.430783 29814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "67add38359d14e07bd86db8133540143"
format_stamp: "Formatted at 2026-08-06 17:01:35 on dist-test-slave-cbsf"
server_key: "9ac2a2f34f2b07ff77eb146d1fc525db"
server_key_iv: "ed1188cb0cad292faf6669aa28caff42"
server_key_version: "encryptionkey@0"
I20260806 17:01:35.431493 29814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "67add38359d14e07bd86db8133540143"
format_stamp: "Formatted at 2026-08-06 17:01:35 on dist-test-slave-cbsf"
server_key: "9ac2a2f34f2b07ff77eb146d1fc525db"
server_key_iv: "ed1188cb0cad292faf6669aa28caff42"
server_key_version: "encryptionkey@0"
I20260806 17:01:35.436242 29814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 17:01:35.440615 29830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:35.442600 29814 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:35.442832 29814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "67add38359d14e07bd86db8133540143"
format_stamp: "Formatted at 2026-08-06 17:01:35 on dist-test-slave-cbsf"
server_key: "9ac2a2f34f2b07ff77eb146d1fc525db"
server_key_iv: "ed1188cb0cad292faf6669aa28caff42"
server_key_version: "encryptionkey@0"
I20260806 17:01:35.443004 29814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:35.505411 29814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:35.509512 29814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:35.509701 29814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:35.517570 29814 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37389
I20260806 17:01:35.517599 29884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37389 every 8 connection(s)
I20260806 17:01:35.518646 29814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:35.521874 29885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:35.526183 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29814
I20260806 17:01:35.526320 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:35.526656 7780 external_mini_cluster.cc:1428] Setting key b0e888d965012dd55dc13e4735ef0ff1
I20260806 17:01:35.528426 29885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143: Bootstrap starting.
I20260806 17:01:35.531399 29885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:35.532238 29885 log.cc:824] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:35.534821 29885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143: No bootstrap required, opened a new log
Aug 06 17:01:35 dist-test-slave-cbsf krb5kdc[29799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 17:01:35.539063 29885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67add38359d14e07bd86db8133540143" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37389 } }
I20260806 17:01:35.539371 29885 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:35.539435 29885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67add38359d14e07bd86db8133540143, State: Initialized, Role: FOLLOWER
I20260806 17:01:35.539968 29885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67add38359d14e07bd86db8133540143" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37389 } }
I20260806 17:01:35.540135 29885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:35.540210 29885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:35.540344 29885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:35.541460 29885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67add38359d14e07bd86db8133540143" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37389 } }
I20260806 17:01:35.541895 29885 leader_election.cc:302] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67add38359d14e07bd86db8133540143; no voters:
I20260806 17:01:35.542317 29885 leader_election.cc:288] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:35.542405 29892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:35.542609 29892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [term 1 LEADER]: Becoming Leader. State: Replica: 67add38359d14e07bd86db8133540143, State: Running, Role: LEADER
I20260806 17:01:35.542897 29890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:35.528256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47373 (local address 127.0.0.1:37389)
0806 17:01:35.528795 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:35.528813 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:35.528849 (+ 36us) server_negotiation.cc:407] Connection header received
0806 17:01:35.529537 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:35.529555 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:35.529924 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:35.530219 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:35.531259 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:35.532452 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:35.533568 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:35.534091 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:35.534229 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:35.537305 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:35.537311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:35.537328 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:35.537360 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:35.539248 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:35.539802 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:35.539808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:35.539813 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:35.539937 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:35.540269 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:35.540273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:35.540275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:35.540913 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:35.541157 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:35.541497 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 17:01:35.541839 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":177,"threads_started":1}
I20260806 17:01:35.542927 29892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67add38359d14e07bd86db8133540143" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37389 } }
I20260806 17:01:35.543742 29885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:35.544792 29894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67add38359d14e07bd86db8133540143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67add38359d14e07bd86db8133540143" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37389 } } }
I20260806 17:01:35.544922 29894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:35.545272 29893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67add38359d14e07bd86db8133540143. Latest consensus state: current_term: 1 leader_uuid: "67add38359d14e07bd86db8133540143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67add38359d14e07bd86db8133540143" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37389 } } }
I20260806 17:01:35.545377 29893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:35.547030 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 17:01:35.549909 29909 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:35.550029 29909 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:35.550112 29903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:35.551170 29903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:35.558172 29903 catalog_manager.cc:1347] Generated new cluster ID: f49a6c1a425041dcb09f0d002c959acf
I20260806 17:01:35.558255 29903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:35.559818 29890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:35.549479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58211 (local address 127.0.0.1:37389)
0806 17:01:35.549605 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:35.549610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:35.550388 (+ 778us) server_negotiation.cc:407] Connection header received
0806 17:01:35.550529 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:35.550532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:35.550586 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:35.550694 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:35.551624 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:35.552479 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:35.553552 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:35.553824 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:35.553950 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:35.555456 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:35.555460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:35.555463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:35.555494 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:35.557587 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:35.558201 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:35.558205 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:35.558207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:35.558432 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:35.558775 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:35.558779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:35.558781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:35.559040 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:35.559197 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:35.559500 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 17:01:35.559645 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 17:01:35.574049 29903 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:35.575227 29903 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:35.583382 29903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67add38359d14e07bd86db8133540143: Generated new TSK 0
I20260806 17:01:35.584738 29903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:35.596815 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29814
2026-08-06T17:01:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1575 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:35 dist-test-slave-cbsf krb5kdc[29921](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:35 dist-test-slave-cbsf krb5kdc[29921](info): set up 2 sockets
Aug 06 17:01:35 dist-test-slave-cbsf krb5kdc[29921](info): commencing operation
krb5kdc: starting...
W20260806 17:01:36.697247 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.007s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:36 dist-test-slave-cbsf krb5kdc[29921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:36.844672 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38493
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:36.966912 29935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:36.967312 29935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:36.967394 29935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:36.971860 29935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:36.971999 29935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:36.972034 29935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:36.972059 29935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:36.972107 29935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:36.978497 29935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:36.979843 29935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:36.981053 29935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:36.990763 29940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:36.990922 29943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:36.990756 29941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:36.991019 29935 server_base.cc:1034] running on GCE node
I20260806 17:01:36.991799 29935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:36.993266 29935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:36.994490 29935 hybrid_clock.cc:648] HybridClock initialized: now 1786035696994457 us; error 57 us; skew 500 ppm
Aug 06 17:01:36 dist-test-slave-cbsf krb5kdc[29921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035696, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:36.998574 29935 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:36.999969 29935 webserver.cc:460] Webserver started at http://127.0.0.1:32797/ using document root <none> and password file <none>
I20260806 17:01:37.000856 29935 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:37.000967 29935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:37.001278 29935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:37.003757 29935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "11471997ef6546d1b0b05112f6580c88"
format_stamp: "Formatted at 2026-08-06 17:01:36 on dist-test-slave-cbsf"
server_key: "aa6afee490b6024364c62878ba86997a"
server_key_iv: "79612056f78f1a4fd767725d3ba528ed"
server_key_version: "encryptionkey@0"
I20260806 17:01:37.004347 29935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "11471997ef6546d1b0b05112f6580c88"
format_stamp: "Formatted at 2026-08-06 17:01:36 on dist-test-slave-cbsf"
server_key: "aa6afee490b6024364c62878ba86997a"
server_key_iv: "79612056f78f1a4fd767725d3ba528ed"
server_key_version: "encryptionkey@0"
I20260806 17:01:37.008848 29935 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260806 17:01:37.011765 29950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:37.013478 29935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:37.013674 29935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "11471997ef6546d1b0b05112f6580c88"
format_stamp: "Formatted at 2026-08-06 17:01:36 on dist-test-slave-cbsf"
server_key: "aa6afee490b6024364c62878ba86997a"
server_key_iv: "79612056f78f1a4fd767725d3ba528ed"
server_key_version: "encryptionkey@0"
I20260806 17:01:37.013827 29935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:37.035349 29935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:37.039014 29935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:37.039288 29935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:37.047401 29935 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38493
I20260806 17:01:37.047431 30007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38493 every 8 connection(s)
I20260806 17:01:37.048633 29935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:37.051848 30008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:37.053961 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 29935
I20260806 17:01:37.054142 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:37.054462 7780 external_mini_cluster.cc:1428] Setting key 8040d4ceba9c28694eec025290acb350
I20260806 17:01:37.059404 30008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88: Bootstrap starting.
I20260806 17:01:37.062139 30008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:37.063009 30008 log.cc:824] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:37.064549 30011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:37.056112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55447 (local address 127.0.0.1:38493)
0806 17:01:37.056665 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:37.056682 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:37.056783 (+ 101us) server_negotiation.cc:407] Connection header received
0806 17:01:37.057507 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:37.057525 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:37.057906 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:37.058274 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:37.058721 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:37.059824 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:37.060828 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:37.061350 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:37.061538 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:37.062544 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:37.062550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:37.062565 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:37.062997 (+ 432us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:37.063062 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:37.063112 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:37.063283 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:37.063443 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 17:01:37.063706 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":161,"threads_started":1}
I20260806 17:01:37.065394 30008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88: No bootstrap required, opened a new log
I20260806 17:01:37.068079 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:37.070535 30008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11471997ef6546d1b0b05112f6580c88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38493 } }
I20260806 17:01:37.071190 30008 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:37.071273 30008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11471997ef6546d1b0b05112f6580c88, State: Initialized, Role: FOLLOWER
I20260806 17:01:37.071867 30008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11471997ef6546d1b0b05112f6580c88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38493 } }
I20260806 17:01:37.072057 30008 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:37.072158 30008 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:37.072289 30008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:37.073724 30008 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11471997ef6546d1b0b05112f6580c88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38493 } }
I20260806 17:01:37.074213 30008 leader_election.cc:302] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11471997ef6546d1b0b05112f6580c88; no voters:
I20260806 17:01:37.074702 30008 leader_election.cc:288] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:37.074982 30018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:37.075234 30018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [term 1 LEADER]: Becoming Leader. State: Replica: 11471997ef6546d1b0b05112f6580c88, State: Running, Role: LEADER
I20260806 17:01:37.075618 30018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11471997ef6546d1b0b05112f6580c88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38493 } }
I20260806 17:01:37.075819 30011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:37.070970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55811 (local address 127.0.0.1:38493)
0806 17:01:37.071141 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:37.071146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:37.071163 (+ 17us) server_negotiation.cc:407] Connection header received
0806 17:01:37.071239 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:37.071242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:37.071323 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:37.071408 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:37.071750 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:37.072448 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:37.073623 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:37.073908 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:37.074005 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:37.075041 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:37.075046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:37.075049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:37.075065 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:37.075101 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:37.075116 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:37.075212 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:37.075614 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 17:01:37.075680 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 17:01:37.076439 30008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:37.077479 30022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11471997ef6546d1b0b05112f6580c88. Latest consensus state: current_term: 1 leader_uuid: "11471997ef6546d1b0b05112f6580c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11471997ef6546d1b0b05112f6580c88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38493 } } }
I20260806 17:01:37.077677 30022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:37.077967 30019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11471997ef6546d1b0b05112f6580c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11471997ef6546d1b0b05112f6580c88" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38493 } } }
I20260806 17:01:37.078081 30019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:37.078186 30030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:37.081866 30030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:37.088549 30030 catalog_manager.cc:1347] Generated new cluster ID: b2b9f4c32fcb4194ad7d986cc995369a
I20260806 17:01:37.088666 30030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:37.104053 30030 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:37.105559 30030 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:37.114392 30030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11471997ef6546d1b0b05112f6580c88: Generated new TSK 0
I20260806 17:01:37.115320 30030 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:37.128263 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 29935
2026-08-06T17:01:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1530 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:37 dist-test-slave-cbsf krb5kdc[30046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:37 dist-test-slave-cbsf krb5kdc[30046](info): set up 2 sockets
Aug 06 17:01:37 dist-test-slave-cbsf krb5kdc[30046](info): commencing operation
krb5kdc: starting...
W20260806 17:01:38.233560 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:38 dist-test-slave-cbsf krb5kdc[30046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:38.372474 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34667
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:38.496511 30059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:38.496929 30059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:38.497013 30059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:38.501480 30059 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:38.501601 30059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:38.501646 30059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:38.501685 30059 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:38.501718 30059 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:38.507431 30059 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:38.508671 30059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:38.509836 30059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:38.519398 30066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:38.519402 30068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:38.519556 30059 server_base.cc:1034] running on GCE node
W20260806 17:01:38.519865 30065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:38.520514 30059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:38.521782 30059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:38.522982 30059 hybrid_clock.cc:648] HybridClock initialized: now 1786035698522965 us; error 36 us; skew 500 ppm
Aug 06 17:01:38 dist-test-slave-cbsf krb5kdc[30046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035698, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:38.525951 30059 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:38.526988 30059 webserver.cc:460] Webserver started at http://127.0.0.1:38893/ using document root <none> and password file <none>
I20260806 17:01:38.527567 30059 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:38.527634 30059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:38.527817 30059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:38.530103 30059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "b5618fd6b95d4bb0a74e35876c9e3950"
format_stamp: "Formatted at 2026-08-06 17:01:38 on dist-test-slave-cbsf"
server_key: "0ebc2a536fc9c0a8652984caa3041377"
server_key_iv: "65b302c173817ffba7d70cdd6766ae17"
server_key_version: "encryptionkey@0"
I20260806 17:01:38.530752 30059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "b5618fd6b95d4bb0a74e35876c9e3950"
format_stamp: "Formatted at 2026-08-06 17:01:38 on dist-test-slave-cbsf"
server_key: "0ebc2a536fc9c0a8652984caa3041377"
server_key_iv: "65b302c173817ffba7d70cdd6766ae17"
server_key_version: "encryptionkey@0"
I20260806 17:01:38.535012 30059 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:38.537915 30075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:38.539927 30059 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:38.540271 30059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "b5618fd6b95d4bb0a74e35876c9e3950"
format_stamp: "Formatted at 2026-08-06 17:01:38 on dist-test-slave-cbsf"
server_key: "0ebc2a536fc9c0a8652984caa3041377"
server_key_iv: "65b302c173817ffba7d70cdd6766ae17"
server_key_version: "encryptionkey@0"
I20260806 17:01:38.540499 30059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:38.546444 30059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:38.550238 30059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:38.550506 30059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:38.558553 30059 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34667
I20260806 17:01:38.558583 30129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34667 every 8 connection(s)
I20260806 17:01:38.559653 30059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:38.561316 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30059
I20260806 17:01:38.561483 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:38.561802 7780 external_mini_cluster.cc:1428] Setting key 2496007945e3ea824f03aee0892e395d
I20260806 17:01:38.563237 30130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:38.567523 30135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:38.563412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36577 (local address 127.0.0.1:34667)
0806 17:01:38.563894 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:38.563911 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:38.563949 (+ 38us) server_negotiation.cc:407] Connection header received
0806 17:01:38.564630 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:38.564647 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:38.565014 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:38.565386 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:38.566260 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:38.566265 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:38.566278 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:38.566289 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:38.566347 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:38.566367 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:38.566531 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:38.566606 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 17:01:38.566776 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":156,"threads_started":1}
I20260806 17:01:38.570037 30130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950: Bootstrap starting.
I20260806 17:01:38.571041 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:38.572736 30130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:38.573681 30130 log.cc:824] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:38.575318 30135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:38.573412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36781 (local address 127.0.0.1:34667)
0806 17:01:38.573569 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:38.573575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:38.573853 (+ 278us) server_negotiation.cc:407] Connection header received
0806 17:01:38.573993 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:38.573996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:38.574031 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:38.574104 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:38.574913 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:38.574917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:38.574920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:38.574932 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:38.574961 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:38.574975 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:38.575071 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:38.575153 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 17:01:38.575194 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 17:01:38.576262 30130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950: No bootstrap required, opened a new log
I20260806 17:01:38.580359 30130 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260806 17:01:38.580693 30130 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:38.580807 30130 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5618fd6b95d4bb0a74e35876c9e3950, State: Initialized, Role: FOLLOWER
I20260806 17:01:38.581269 30130 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260806 17:01:38.581439 30130 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:38.581530 30130 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:38.581672 30130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:38.582738 30130 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260806 17:01:38.583137 30130 leader_election.cc:302] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5618fd6b95d4bb0a74e35876c9e3950; no voters:
I20260806 17:01:38.583513 30130 leader_election.cc:288] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:38.583735 30142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:38.584051 30142 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [term 1 LEADER]: Becoming Leader. State: Replica: b5618fd6b95d4bb0a74e35876c9e3950, State: Running, Role: LEADER
I20260806 17:01:38.584419 30142 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } }
I20260806 17:01:38.584959 30130 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:38.585763 30142 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5618fd6b95d4bb0a74e35876c9e3950. Latest consensus state: current_term: 1 leader_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } } }
I20260806 17:01:38.585898 30142 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:38.586237 30143 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5618fd6b95d4bb0a74e35876c9e3950" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34667 } } }
I20260806 17:01:38.586334 30143 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950 [sys.catalog]: This master's current role is: LEADER
W20260806 17:01:38.590019 30157 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:38.590137 30157 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:38.590229 30149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:38.591030 30149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:38.597559 30149 catalog_manager.cc:1347] Generated new cluster ID: 334134af344c4484bed6e7793c8f0d45
I20260806 17:01:38.597653 30149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:38.617908 30149 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:38.618335 30149 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:38.623008 30149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5618fd6b95d4bb0a74e35876c9e3950: Generated new TSK 0
I20260806 17:01:38.623941 30149 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:38.636055 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30059
2026-08-06T17:01:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1507 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:38 dist-test-slave-cbsf krb5kdc[30163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:38 dist-test-slave-cbsf krb5kdc[30163](info): set up 2 sockets
Aug 06 17:01:38 dist-test-slave-cbsf krb5kdc[30163](info): commencing operation
krb5kdc: starting...
W20260806 17:01:39.733768 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:39 dist-test-slave-cbsf krb5kdc[30163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:39.878021 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42771
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:40.000614 30177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:40.000975 30177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:40.001022 30177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:40.005970 30177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:40.006071 30177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:40.006093 30177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:40.006112 30177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:40.006151 30177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:40.012176 30177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:40.013569 30177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:40.014732 30177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:40.025163 30184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:40.025166 30183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:40.025166 30186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:40.025712 30177 server_base.cc:1034] running on GCE node
I20260806 17:01:40.026752 30177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:40.028242 30177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:40.029448 30177 hybrid_clock.cc:648] HybridClock initialized: now 1786035700029413 us; error 58 us; skew 500 ppm
Aug 06 17:01:40 dist-test-slave-cbsf krb5kdc[30163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035700, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:40.037664 30177 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:40.038769 30177 webserver.cc:460] Webserver started at http://127.0.0.1:34895/ using document root <none> and password file <none>
I20260806 17:01:40.039386 30177 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:40.039453 30177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:40.039666 30177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:40.042023 30177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "a55de73f216a4bd3a07bad90551c6cf9"
format_stamp: "Formatted at 2026-08-06 17:01:40 on dist-test-slave-cbsf"
server_key: "d64809669308107d3e78b5eae572a973"
server_key_iv: "a3e76e0e36bfd3bbb0cce4a6cfbd5399"
server_key_version: "encryptionkey@0"
I20260806 17:01:40.042604 30177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "a55de73f216a4bd3a07bad90551c6cf9"
format_stamp: "Formatted at 2026-08-06 17:01:40 on dist-test-slave-cbsf"
server_key: "d64809669308107d3e78b5eae572a973"
server_key_iv: "a3e76e0e36bfd3bbb0cce4a6cfbd5399"
server_key_version: "encryptionkey@0"
I20260806 17:01:40.046931 30177 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:40.049898 30193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:40.051406 30177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:40.051594 30177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "a55de73f216a4bd3a07bad90551c6cf9"
format_stamp: "Formatted at 2026-08-06 17:01:40 on dist-test-slave-cbsf"
server_key: "d64809669308107d3e78b5eae572a973"
server_key_iv: "a3e76e0e36bfd3bbb0cce4a6cfbd5399"
server_key_version: "encryptionkey@0"
I20260806 17:01:40.051744 30177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:40.068538 30177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:40.073659 30177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:40.073941 30177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:40.082389 30177 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42771
I20260806 17:01:40.082584 30247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42771 every 8 connection(s)
I20260806 17:01:40.083781 30177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:40.086936 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30177
I20260806 17:01:40.087144 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:40.087164 30248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:40.087467 7780 external_mini_cluster.cc:1428] Setting key fc62234cb9223a5714529fc0cf588359
I20260806 17:01:40.097172 30248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9: Bootstrap starting.
Aug 06 17:01:40 dist-test-slave-cbsf krb5kdc[30163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 17:01:40.101023 30248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:40.102131 30248 log.cc:824] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:40.105068 30248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9: No bootstrap required, opened a new log
I20260806 17:01:40.108039 30251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:40.089074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:56989 (local address 127.0.0.1:42771)
0806 17:01:40.089554 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:40.089571 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:40.089608 (+ 37us) server_negotiation.cc:407] Connection header received
0806 17:01:40.090608 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:40.090629 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:40.091363 (+ 734us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:40.091841 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:40.093075 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:40.094545 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:40.096297 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:40.097124 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:40.097352 (+ 228us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:40.101399 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:40.101410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:40.101432 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:40.101480 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:40.103796 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:40.104534 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:40.104540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:40.104547 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:40.104735 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:40.105399 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:40.105403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:40.105404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:40.106023 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:40.106275 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:40.106630 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 17:01:40.106891 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":162,"threads_started":1}
I20260806 17:01:40.110316 30248 raft_consensus.cc:348] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55de73f216a4bd3a07bad90551c6cf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42771 } }
I20260806 17:01:40.110685 30248 raft_consensus.cc:374] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:40.110749 30248 raft_consensus.cc:729] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a55de73f216a4bd3a07bad90551c6cf9, State: Initialized, Role: FOLLOWER
I20260806 17:01:40.111274 30248 consensus_queue.cc:260] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55de73f216a4bd3a07bad90551c6cf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42771 } }
I20260806 17:01:40.111469 30248 raft_consensus.cc:388] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:40.111545 30248 raft_consensus.cc:482] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:40.111704 30248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:40.112226 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:40.113088 30248 raft_consensus.cc:504] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55de73f216a4bd3a07bad90551c6cf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42771 } }
I20260806 17:01:40.113492 30248 leader_election.cc:302] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a55de73f216a4bd3a07bad90551c6cf9; no voters:
I20260806 17:01:40.113893 30248 leader_election.cc:288] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:40.113981 30258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:40.114251 30258 raft_consensus.cc:686] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [term 1 LEADER]: Becoming Leader. State: Replica: a55de73f216a4bd3a07bad90551c6cf9, State: Running, Role: LEADER
I20260806 17:01:40.114704 30258 consensus_queue.cc:237] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55de73f216a4bd3a07bad90551c6cf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42771 } }
I20260806 17:01:40.115525 30248 sys_catalog.cc:564] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:40.116613 30261 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a55de73f216a4bd3a07bad90551c6cf9. Latest consensus state: current_term: 1 leader_uuid: "a55de73f216a4bd3a07bad90551c6cf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55de73f216a4bd3a07bad90551c6cf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42771 } } }
I20260806 17:01:40.116953 30259 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a55de73f216a4bd3a07bad90551c6cf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55de73f216a4bd3a07bad90551c6cf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42771 } } }
I20260806 17:01:40.117110 30259 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:40.117451 30261 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9 [sys.catalog]: This master's current role is: LEADER
W20260806 17:01:40.121897 30279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:40.122023 30279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:40.122222 30273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:40.123100 30273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:40.125275 30251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:40.114871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:45997 (local address 127.0.0.1:42771)
0806 17:01:40.115008 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:40.115013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:40.115292 (+ 279us) server_negotiation.cc:407] Connection header received
0806 17:01:40.115469 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:40.115472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:40.115536 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:40.115628 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:40.116538 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:40.117377 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:40.118671 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:40.119046 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:40.119145 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:40.120991 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:40.120998 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:40.121003 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:40.121035 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:40.122929 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:40.123609 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:40.123614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:40.123616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:40.123724 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:40.124167 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:40.124171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:40.124173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:40.124423 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:40.124582 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:40.124986 (+ 404us) server_negotiation.cc:299] Negotiation successful
0806 17:01:40.125098 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 17:01:40.131145 30273 catalog_manager.cc:1347] Generated new cluster ID: 4e98677c4e9b42a795f2f6006da48748
I20260806 17:01:40.131249 30273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:40.151194 30273 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:40.152379 30273 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:40.158802 30273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a55de73f216a4bd3a07bad90551c6cf9: Generated new TSK 0
I20260806 17:01:40.159776 30273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:40.165230 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30177
W20260806 17:01:40.173158 30161 connection.cc:535] client connection to 127.0.0.1:42771 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42771): Connection reset by peer (error 104)
2026-08-06T17:01:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:40 dist-test-slave-cbsf krb5kdc[30285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:40 dist-test-slave-cbsf krb5kdc[30285](info): set up 2 sockets
Aug 06 17:01:40 dist-test-slave-cbsf krb5kdc[30285](info): commencing operation
krb5kdc: starting...
W20260806 17:01:41.269505 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:41 dist-test-slave-cbsf krb5kdc[30285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:41.416504 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46641
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:41.556511 30298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:41.557001 30298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:41.557098 30298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:41.562422 30298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:41.562592 30298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:41.562636 30298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:41.562674 30298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:41.562708 30298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:41.568965 30298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:41.570289 30298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:41.571441 30298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:41.581596 30303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:41.581589 30306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:41.581634 30304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:41.581974 30298 server_base.cc:1034] running on GCE node
I20260806 17:01:41.582829 30298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:41.584154 30298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:41.585386 30298 hybrid_clock.cc:648] HybridClock initialized: now 1786035701585362 us; error 42 us; skew 500 ppm
Aug 06 17:01:41 dist-test-slave-cbsf krb5kdc[30285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035701, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:41.588918 30298 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:41.590085 30298 webserver.cc:460] Webserver started at http://127.0.0.1:46431/ using document root <none> and password file <none>
I20260806 17:01:41.590756 30298 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:41.590868 30298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:41.591158 30298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:41.593647 30298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "b411dc2c037f41b2905db0e3f042ad44"
format_stamp: "Formatted at 2026-08-06 17:01:41 on dist-test-slave-cbsf"
server_key: "0a2fcdc5ac2e6e19935b95c851044701"
server_key_iv: "851f96c6af5ec0a9ab8599fd33e34ff0"
server_key_version: "encryptionkey@0"
I20260806 17:01:41.594380 30298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "b411dc2c037f41b2905db0e3f042ad44"
format_stamp: "Formatted at 2026-08-06 17:01:41 on dist-test-slave-cbsf"
server_key: "0a2fcdc5ac2e6e19935b95c851044701"
server_key_iv: "851f96c6af5ec0a9ab8599fd33e34ff0"
server_key_version: "encryptionkey@0"
I20260806 17:01:41.599788 30298 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 17:01:41.603035 30313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:41.604592 30298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:01:41.604836 30298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "b411dc2c037f41b2905db0e3f042ad44"
format_stamp: "Formatted at 2026-08-06 17:01:41 on dist-test-slave-cbsf"
server_key: "0a2fcdc5ac2e6e19935b95c851044701"
server_key_iv: "851f96c6af5ec0a9ab8599fd33e34ff0"
server_key_version: "encryptionkey@0"
I20260806 17:01:41.604996 30298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:41.622215 30298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:41.626016 30298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:41.626247 30298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:41.634145 30298 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46641
I20260806 17:01:41.634166 30370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46641 every 8 connection(s)
I20260806 17:01:41.635206 30298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:41.637424 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30298
I20260806 17:01:41.637596 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:41.637900 7780 external_mini_cluster.cc:1428] Setting key 2005e7ef86044433b971bfe27b2e6d2b
I20260806 17:01:41.638536 30371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:41.646441 30371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44: Bootstrap starting.
I20260806 17:01:41.649168 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:41.639448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:57723 (local address 127.0.0.1:46641)
0806 17:01:41.639908 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:41.639929 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:41.639974 (+ 45us) server_negotiation.cc:407] Connection header received
0806 17:01:41.640945 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:41.640970 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:41.641452 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:41.641920 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:41.642382 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:41.643929 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:41.644998 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:41.645745 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:41.645914 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:41.646908 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:41.646915 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:41.646933 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:41.647450 (+ 517us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:41.647529 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:41.647562 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:41.647720 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:41.647993 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 17:01:41.648147 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":126,"threads_started":1}
I20260806 17:01:41.649559 30371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:41.650478 30371 log.cc:824] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:41.652683 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:41.653056 30371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44: No bootstrap required, opened a new log
I20260806 17:01:41.657789 30371 raft_consensus.cc:348] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b411dc2c037f41b2905db0e3f042ad44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46641 } }
I20260806 17:01:41.658151 30371 raft_consensus.cc:374] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:41.658247 30371 raft_consensus.cc:729] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b411dc2c037f41b2905db0e3f042ad44, State: Initialized, Role: FOLLOWER
I20260806 17:01:41.658788 30371 consensus_queue.cc:260] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b411dc2c037f41b2905db0e3f042ad44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46641 } }
I20260806 17:01:41.658994 30371 raft_consensus.cc:388] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:41.659096 30371 raft_consensus.cc:482] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:41.659224 30371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:41.659740 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:41.655163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:42375 (local address 127.0.0.1:46641)
0806 17:01:41.655316 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:41.655322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:41.655605 (+ 283us) server_negotiation.cc:407] Connection header received
0806 17:01:41.655735 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:41.655737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:41.655783 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:41.655871 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:41.656176 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:41.656766 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:41.657897 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:41.658124 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:41.658252 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:41.659179 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:41.659185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:41.659189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:41.659205 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:41.659235 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:41.659253 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:41.659356 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:41.659539 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 17:01:41.659573 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 17:01:41.660423 30371 raft_consensus.cc:504] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b411dc2c037f41b2905db0e3f042ad44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46641 } }
I20260806 17:01:41.660854 30371 leader_election.cc:302] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b411dc2c037f41b2905db0e3f042ad44; no voters:
I20260806 17:01:41.661199 30371 leader_election.cc:288] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:41.661345 30381 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:41.661597 30381 raft_consensus.cc:686] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [term 1 LEADER]: Becoming Leader. State: Replica: b411dc2c037f41b2905db0e3f042ad44, State: Running, Role: LEADER
I20260806 17:01:41.661968 30381 consensus_queue.cc:237] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b411dc2c037f41b2905db0e3f042ad44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46641 } }
I20260806 17:01:41.662539 30371 sys_catalog.cc:564] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:41.663717 30383 sys_catalog.cc:455] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b411dc2c037f41b2905db0e3f042ad44. Latest consensus state: current_term: 1 leader_uuid: "b411dc2c037f41b2905db0e3f042ad44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b411dc2c037f41b2905db0e3f042ad44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46641 } } }
I20260806 17:01:41.663857 30383 sys_catalog.cc:458] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:41.663997 30382 sys_catalog.cc:455] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b411dc2c037f41b2905db0e3f042ad44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b411dc2c037f41b2905db0e3f042ad44" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46641 } } }
I20260806 17:01:41.664149 30382 sys_catalog.cc:458] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44 [sys.catalog]: This master's current role is: LEADER
W20260806 17:01:41.667804 30397 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:41.667913 30397 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:41.668005 30392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:41.668812 30392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:41.675077 30392 catalog_manager.cc:1347] Generated new cluster ID: 2bdf48cd46194b53b83efe5b89fa712e
I20260806 17:01:41.675242 30392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:41.687494 30392 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:41.688586 30392 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:41.693936 30392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b411dc2c037f41b2905db0e3f042ad44: Generated new TSK 0
I20260806 17:01:41.694768 30392 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:41.706677 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30298
W20260806 17:01:41.714807 30283 connection.cc:535] client connection to 127.0.0.1:46641 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46641): Connection reset by peer (error 104)
2026-08-06T17:01:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:41 dist-test-slave-cbsf krb5kdc[30404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:41 dist-test-slave-cbsf krb5kdc[30404](info): set up 2 sockets
Aug 06 17:01:41 dist-test-slave-cbsf krb5kdc[30404](info): commencing operation
krb5kdc: starting...
W20260806 17:01:42.802639 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:42 dist-test-slave-cbsf krb5kdc[30404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:42.943598 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:43.067873 30420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:43.068253 30420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:43.068336 30420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:43.072757 30420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:43.072882 30420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:43.072919 30420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:43.072957 30420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:43.072993 30420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:43.079015 30420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:43.080283 30420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:43.081470 30420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:43.091177 30430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:43.091181 30426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:43.091177 30427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:43.092037 30420 server_base.cc:1034] running on GCE node
I20260806 17:01:43.092759 30420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:43.094038 30420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:43.095227 30420 hybrid_clock.cc:648] HybridClock initialized: now 1786035703095195 us; error 51 us; skew 500 ppm
Aug 06 17:01:43 dist-test-slave-cbsf krb5kdc[30404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035703, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:43.098754 30420 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:43.099967 30420 webserver.cc:460] Webserver started at http://127.0.0.1:37037/ using document root <none> and password file <none>
I20260806 17:01:43.100734 30420 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:43.100850 30420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:43.101115 30420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:43.103633 30420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "8a241979842d4e30b3cd151f6c5ff4d3"
format_stamp: "Formatted at 2026-08-06 17:01:43 on dist-test-slave-cbsf"
server_key: "c841f691eff78a96f8381b6394345873"
server_key_iv: "a7516fe14b03be986a56cfaf3615e65c"
server_key_version: "encryptionkey@0"
I20260806 17:01:43.104347 30420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "8a241979842d4e30b3cd151f6c5ff4d3"
format_stamp: "Formatted at 2026-08-06 17:01:43 on dist-test-slave-cbsf"
server_key: "c841f691eff78a96f8381b6394345873"
server_key_iv: "a7516fe14b03be986a56cfaf3615e65c"
server_key_version: "encryptionkey@0"
I20260806 17:01:43.109552 30420 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 17:01:43.113724 30439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:43.116035 30420 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:43.116453 30420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "8a241979842d4e30b3cd151f6c5ff4d3"
format_stamp: "Formatted at 2026-08-06 17:01:43 on dist-test-slave-cbsf"
server_key: "c841f691eff78a96f8381b6394345873"
server_key_iv: "a7516fe14b03be986a56cfaf3615e65c"
server_key_version: "encryptionkey@0"
I20260806 17:01:43.116673 30420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:43.122349 30420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:43.126169 30420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:43.126408 30420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:43.134256 30420 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40927
I20260806 17:01:43.134291 30491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40927 every 8 connection(s)
I20260806 17:01:43.135315 30420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:43.138520 30492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:43.142432 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30420
I20260806 17:01:43.142616 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:43.142951 7780 external_mini_cluster.cc:1428] Setting key e26bdcbbc5dda0bcd2123149be1e7259
I20260806 17:01:43.145608 30492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3: Bootstrap starting.
I20260806 17:01:43.148365 30492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:43.148837 30495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:43.144533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:49891 (local address 127.0.0.1:40927)
0806 17:01:43.145110 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:43.145128 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:43.145168 (+ 40us) server_negotiation.cc:407] Connection header received
0806 17:01:43.145913 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:43.145932 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:43.146236 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:43.146547 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:43.147429 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:43.147434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:43.147447 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:43.147458 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:43.147524 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:43.147547 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:43.147668 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:43.147773 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 17:01:43.147969 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":243,"threads_started":1}
I20260806 17:01:43.149338 30492 log.cc:824] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:43.151695 30492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3: No bootstrap required, opened a new log
I20260806 17:01:43.151971 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:43.156152 30495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:43.154221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:57925 (local address 127.0.0.1:40927)
0806 17:01:43.154346 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:43.154350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:43.154523 (+ 173us) server_negotiation.cc:407] Connection header received
0806 17:01:43.154696 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:43.154699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:43.154733 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:43.154814 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:43.155695 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:43.155699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:43.155701 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:43.155714 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:43.155748 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:43.155758 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:43.155848 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:43.155951 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 17:01:43.155998 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 17:01:43.156670 30492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40927 } }
I20260806 17:01:43.157008 30492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:43.157084 30492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a241979842d4e30b3cd151f6c5ff4d3, State: Initialized, Role: FOLLOWER
I20260806 17:01:43.157612 30492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40927 } }
I20260806 17:01:43.157794 30492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:43.157879 30492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:43.158001 30492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:43.159080 30492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40927 } }
I20260806 17:01:43.159469 30492 leader_election.cc:302] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a241979842d4e30b3cd151f6c5ff4d3; no voters:
I20260806 17:01:43.159857 30492 leader_election.cc:288] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:43.160005 30502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:43.160339 30502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [term 1 LEADER]: Becoming Leader. State: Replica: 8a241979842d4e30b3cd151f6c5ff4d3, State: Running, Role: LEADER
I20260806 17:01:43.160771 30502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40927 } }
I20260806 17:01:43.161391 30492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:43.162618 30503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40927 } } }
I20260806 17:01:43.162763 30503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:43.163152 30504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a241979842d4e30b3cd151f6c5ff4d3. Latest consensus state: current_term: 1 leader_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a241979842d4e30b3cd151f6c5ff4d3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40927 } } }
I20260806 17:01:43.163323 30504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:43.164209 30513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:43.167461 30513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:43.173205 30513 catalog_manager.cc:1347] Generated new cluster ID: 19443833b0804b9196ff6826ff051467
I20260806 17:01:43.173305 30513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:43.193922 30513 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:43.194355 30513 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:43.205785 30513 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a241979842d4e30b3cd151f6c5ff4d3: Generated new TSK 0
I20260806 17:01:43.207474 30513 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:43.216321 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30420
2026-08-06T17:01:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1509 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:43 dist-test-slave-cbsf krb5kdc[30527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:43 dist-test-slave-cbsf krb5kdc[30527](info): set up 2 sockets
Aug 06 17:01:43 dist-test-slave-cbsf krb5kdc[30527](info): commencing operation
krb5kdc: starting...
W20260806 17:01:44.304674 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:44 dist-test-slave-cbsf krb5kdc[30527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:44.444096 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:44.568787 30541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:44.569156 30541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:44.569242 30541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:44.573616 30541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:44.573719 30541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:44.573765 30541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:44.573823 30541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:44.573858 30541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:44.579679 30541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:44.581035 30541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:44.582170 30541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:44.591423 30547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:44.591423 30549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:44.591441 30546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:44.591529 30541 server_base.cc:1034] running on GCE node
I20260806 17:01:44.592509 30541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:44.593806 30541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:44.595012 30541 hybrid_clock.cc:648] HybridClock initialized: now 1786035704595000 us; error 59 us; skew 500 ppm
Aug 06 17:01:44 dist-test-slave-cbsf krb5kdc[30527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:44.598322 30541 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:44.599377 30541 webserver.cc:460] Webserver started at http://127.0.0.1:46449/ using document root <none> and password file <none>
I20260806 17:01:44.600003 30541 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:44.600098 30541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:44.600354 30541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:44.602662 30541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "a57f3607fc4f43c5bf338995a3701867"
format_stamp: "Formatted at 2026-08-06 17:01:44 on dist-test-slave-cbsf"
server_key: "482b783f2cb372bd85e814796406009c"
server_key_iv: "5e3b0a7c308fe1be2089afe31f8b9afa"
server_key_version: "encryptionkey@0"
I20260806 17:01:44.603282 30541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "a57f3607fc4f43c5bf338995a3701867"
format_stamp: "Formatted at 2026-08-06 17:01:44 on dist-test-slave-cbsf"
server_key: "482b783f2cb372bd85e814796406009c"
server_key_iv: "5e3b0a7c308fe1be2089afe31f8b9afa"
server_key_version: "encryptionkey@0"
I20260806 17:01:44.607488 30541 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 17:01:44.610579 30557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:44.611891 30541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 17:01:44.612058 30541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "a57f3607fc4f43c5bf338995a3701867"
format_stamp: "Formatted at 2026-08-06 17:01:44 on dist-test-slave-cbsf"
server_key: "482b783f2cb372bd85e814796406009c"
server_key_iv: "5e3b0a7c308fe1be2089afe31f8b9afa"
server_key_version: "encryptionkey@0"
I20260806 17:01:44.612200 30541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:44.632254 30541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:44.636045 30541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:44.636276 30541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:44.644454 30541 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45345
I20260806 17:01:44.644488 30613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45345 every 8 connection(s)
I20260806 17:01:44.645591 30541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:44.648820 30614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:44.653225 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30541
I20260806 17:01:44.653407 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:44.653744 7780 external_mini_cluster.cc:1428] Setting key 6201521506995897afc23e534e2c2ab6
I20260806 17:01:44.656070 30614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867: Bootstrap starting.
I20260806 17:01:44.659041 30614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:44.660149 30614 log.cc:824] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:44.662634 30614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867: No bootstrap required, opened a new log
Aug 06 17:01:44 dist-test-slave-cbsf krb5kdc[30527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 17:01:44.666827 30614 raft_consensus.cc:348] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57f3607fc4f43c5bf338995a3701867" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45345 } }
I20260806 17:01:44.667114 30614 raft_consensus.cc:374] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:44.667151 30614 raft_consensus.cc:729] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a57f3607fc4f43c5bf338995a3701867, State: Initialized, Role: FOLLOWER
I20260806 17:01:44.667752 30614 consensus_queue.cc:260] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57f3607fc4f43c5bf338995a3701867" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45345 } }
I20260806 17:01:44.667953 30614 raft_consensus.cc:388] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:44.668048 30614 raft_consensus.cc:482] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:44.668193 30614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:44.669513 30614 raft_consensus.cc:504] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57f3607fc4f43c5bf338995a3701867" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45345 } }
I20260806 17:01:44.669976 30614 leader_election.cc:302] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a57f3607fc4f43c5bf338995a3701867; no voters:
I20260806 17:01:44.670359 30614 leader_election.cc:288] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:44.670486 30619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:44.670746 30619 raft_consensus.cc:686] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [term 1 LEADER]: Becoming Leader. State: Replica: a57f3607fc4f43c5bf338995a3701867, State: Running, Role: LEADER
I20260806 17:01:44.671164 30619 consensus_queue.cc:237] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57f3607fc4f43c5bf338995a3701867" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45345 } }
I20260806 17:01:44.671326 30617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:44.655476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:42011 (local address 127.0.0.1:45345)
0806 17:01:44.655985 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:44.656001 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:44.656041 (+ 40us) server_negotiation.cc:407] Connection header received
0806 17:01:44.656896 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:44.656916 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:44.657313 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:44.657697 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:44.658577 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:44.659715 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:44.660663 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:44.661240 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:44.661436 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:44.664537 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:44.664544 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:44.664562 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:44.664596 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:44.667274 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:44.668027 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:44.668034 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:44.668057 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:44.668248 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:44.668672 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:44.668675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:44.668676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:44.669197 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:44.669420 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:44.669844 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 17:01:44.670139 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":168,"threads_started":1}
I20260806 17:01:44.671815 30614 sys_catalog.cc:564] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:44.673023 30620 sys_catalog.cc:455] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a57f3607fc4f43c5bf338995a3701867" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57f3607fc4f43c5bf338995a3701867" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45345 } } }
I20260806 17:01:44.673172 30620 sys_catalog.cc:458] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:44.673410 30620 sys_catalog.cc:455] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a57f3607fc4f43c5bf338995a3701867. Latest consensus state: current_term: 1 leader_uuid: "a57f3607fc4f43c5bf338995a3701867" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a57f3607fc4f43c5bf338995a3701867" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45345 } } }
I20260806 17:01:44.673496 30620 sys_catalog.cc:458] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:44.673923 30629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:44.675160 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:44.678577 30629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:44.686118 30629 catalog_manager.cc:1347] Generated new cluster ID: b7dd75e3aa09443c9de01e17e926ea0f
I20260806 17:01:44.686195 30629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:44.688019 30617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:44.677636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:35651 (local address 127.0.0.1:45345)
0806 17:01:44.677781 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:44.677786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:44.678060 (+ 274us) server_negotiation.cc:407] Connection header received
0806 17:01:44.678201 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:44.678204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:44.678256 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:44.678353 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:44.679312 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:44.680159 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:44.681456 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:44.681815 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:44.681927 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:44.683942 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:44.683946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:44.683949 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:44.683979 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:44.685801 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:44.686531 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:44.686535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:44.686537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:44.686636 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:44.687038 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:44.687042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:44.687043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:44.687295 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:44.687450 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:44.687749 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 17:01:44.687858 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 17:01:44.701356 30629 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:44.702872 30629 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:44.713454 30629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a57f3607fc4f43c5bf338995a3701867: Generated new TSK 0
I20260806 17:01:44.714624 30629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:44.721297 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30541
W20260806 17:01:44.730916 30525 connection.cc:535] client connection to 127.0.0.1:45345 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45345): Connection reset by peer (error 104)
2026-08-06T17:01:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1506 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:44 dist-test-slave-cbsf krb5kdc[30647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:44 dist-test-slave-cbsf krb5kdc[30647](info): set up 2 sockets
Aug 06 17:01:44 dist-test-slave-cbsf krb5kdc[30647](info): commencing operation
krb5kdc: starting...
W20260806 17:01:45.815732 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:45 dist-test-slave-cbsf krb5kdc[30647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:45.955973 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:46.079226 30663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:46.079627 30663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:46.079723 30663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:46.084056 30663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:46.084165 30663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:46.084203 30663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:46.084239 30663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:46.084276 30663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:46.090463 30663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44039
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:46.091805 30663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:46.092993 30663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:46.102515 30668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:46.102515 30669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:46.102548 30671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:46.102948 30663 server_base.cc:1034] running on GCE node
I20260806 17:01:46.103646 30663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:46.105031 30663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:46.106220 30663 hybrid_clock.cc:648] HybridClock initialized: now 1786035706106186 us; error 53 us; skew 500 ppm
Aug 06 17:01:46 dist-test-slave-cbsf krb5kdc[30647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035706, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:46.114562 30663 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:46.115734 30663 webserver.cc:460] Webserver started at http://127.0.0.1:36931/ using document root <none> and password file <none>
I20260806 17:01:46.116403 30663 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:46.116477 30663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:46.116767 30663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:46.119184 30663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06"
format_stamp: "Formatted at 2026-08-06 17:01:46 on dist-test-slave-cbsf"
server_key: "5d2032572b9bac00ce95c58aed72c8f9"
server_key_iv: "5c89cbedb45fdfdc320591bb89b3235b"
server_key_version: "encryptionkey@0"
I20260806 17:01:46.119817 30663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06"
format_stamp: "Formatted at 2026-08-06 17:01:46 on dist-test-slave-cbsf"
server_key: "5d2032572b9bac00ce95c58aed72c8f9"
server_key_iv: "5c89cbedb45fdfdc320591bb89b3235b"
server_key_version: "encryptionkey@0"
I20260806 17:01:46.124347 30663 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 17:01:46.127447 30679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:46.129026 30663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:46.129192 30663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06"
format_stamp: "Formatted at 2026-08-06 17:01:46 on dist-test-slave-cbsf"
server_key: "5d2032572b9bac00ce95c58aed72c8f9"
server_key_iv: "5c89cbedb45fdfdc320591bb89b3235b"
server_key_version: "encryptionkey@0"
I20260806 17:01:46.129330 30663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:46.173079 30663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:46.176779 30663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:46.177008 30663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:46.184463 30663 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44039
I20260806 17:01:46.184518 30735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44039 every 8 connection(s)
I20260806 17:01:46.185575 30663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:46.188752 30736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:46.195015 30736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06: Bootstrap starting.
I20260806 17:01:46.195546 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30663
I20260806 17:01:46.195709 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:46.196017 7780 external_mini_cluster.cc:1428] Setting key 770a187d01b1862ae4bfefa0c758e2d3
I20260806 17:01:46.198123 30736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:46.198931 30736 log.cc:824] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:46.201232 30736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06: No bootstrap required, opened a new log
I20260806 17:01:46.205943 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:46.197576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:35983 (local address 127.0.0.1:44039)
0806 17:01:46.198039 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:46.198055 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:46.198091 (+ 36us) server_negotiation.cc:407] Connection header received
0806 17:01:46.198843 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:46.198862 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:46.199310 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:46.199723 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:46.200121 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:46.201199 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:46.202437 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:46.202959 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:46.203103 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:46.204083 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:46.204088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:46.204102 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:46.204535 (+ 433us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:46.204596 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:46.204620 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:46.204804 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:46.204960 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 17:01:46.205140 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":157,"threads_started":1}
I20260806 17:01:46.205809 30736 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260806 17:01:46.206117 30736 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:46.206187 30736 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7cf31675c5c4c60a3288fd7d3fd1f06, State: Initialized, Role: FOLLOWER
I20260806 17:01:46.206662 30736 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260806 17:01:46.206784 30736 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:46.206827 30736 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:46.206894 30736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:46.207969 30736 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260806 17:01:46.208372 30736 leader_election.cc:302] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7cf31675c5c4c60a3288fd7d3fd1f06; no voters:
I20260806 17:01:46.208812 30736 leader_election.cc:288] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:46.208886 30741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:46.209074 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:46.209149 30741 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [term 1 LEADER]: Becoming Leader. State: Replica: c7cf31675c5c4c60a3288fd7d3fd1f06, State: Running, Role: LEADER
I20260806 17:01:46.209470 30741 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } }
I20260806 17:01:46.210274 30736 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:46.210737 30741 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7cf31675c5c4c60a3288fd7d3fd1f06. Latest consensus state: current_term: 1 leader_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } } }
I20260806 17:01:46.210860 30741 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:46.211120 30743 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cf31675c5c4c60a3288fd7d3fd1f06" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44039 } } }
I20260806 17:01:46.211320 30751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:46.211355 30743 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:46.215010 30751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:46.216602 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:46.211258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:56537 (local address 127.0.0.1:44039)
0806 17:01:46.211379 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:46.211384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:46.211866 (+ 482us) server_negotiation.cc:407] Connection header received
0806 17:01:46.212069 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:46.212072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:46.212124 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:46.212205 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:46.212601 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:46.213206 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:46.214351 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:46.214697 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:46.214779 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:46.216084 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:46.216087 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:46.216090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:46.216104 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:46.216136 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:46.216147 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:46.216244 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:46.216387 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 17:01:46.216425 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 17:01:46.221784 30751 catalog_manager.cc:1347] Generated new cluster ID: 5f77ae7feecd46c396fbde7a6f0b5ccd
I20260806 17:01:46.221879 30751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:46.229245 30751 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:46.230581 30751 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:46.245507 30751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7cf31675c5c4c60a3288fd7d3fd1f06: Generated new TSK 0
I20260806 17:01:46.246506 30751 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:46.252390 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30663
W20260806 17:01:46.260571 30645 connection.cc:535] client connection to 127.0.0.1:44039 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44039): Connection reset by peer (error 104)
2026-08-06T17:01:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:46 dist-test-slave-cbsf krb5kdc[30770](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:46 dist-test-slave-cbsf krb5kdc[30770](info): set up 2 sockets
Aug 06 17:01:46 dist-test-slave-cbsf krb5kdc[30770](info): commencing operation
krb5kdc: starting...
W20260806 17:01:47.345440 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:47 dist-test-slave-cbsf krb5kdc[30770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 17:01:47.486022 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:47.609467 30783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:47.609874 30783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:47.609961 30783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:47.614377 30783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:47.614486 30783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:47.614527 30783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:47.614584 30783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:47.614624 30783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:47.620597 30783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46431
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:47.622004 30783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:47.623122 30783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:47.632377 30791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:47.632377 30789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:47.632455 30788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:47.632617 30783 server_base.cc:1034] running on GCE node
I20260806 17:01:47.633334 30783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:47.634670 30783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:47.635835 30783 hybrid_clock.cc:648] HybridClock initialized: now 1786035707635809 us; error 44 us; skew 500 ppm
Aug 06 17:01:47 dist-test-slave-cbsf krb5kdc[30770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035707, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:47.638958 30783 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 17:01:47.639997 30783 webserver.cc:460] Webserver started at http://127.0.0.1:43535/ using document root <none> and password file <none>
I20260806 17:01:47.640621 30783 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:47.640748 30783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:47.640998 30783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:47.643306 30783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "7c2cf086d87f4b6d86841a8924802458"
format_stamp: "Formatted at 2026-08-06 17:01:47 on dist-test-slave-cbsf"
server_key: "743bf006c230d1aeeb3168372438db9f"
server_key_iv: "23c0fd8a853b8f44e30e5dd9cb977c8f"
server_key_version: "encryptionkey@0"
I20260806 17:01:47.643970 30783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "7c2cf086d87f4b6d86841a8924802458"
format_stamp: "Formatted at 2026-08-06 17:01:47 on dist-test-slave-cbsf"
server_key: "743bf006c230d1aeeb3168372438db9f"
server_key_iv: "23c0fd8a853b8f44e30e5dd9cb977c8f"
server_key_version: "encryptionkey@0"
I20260806 17:01:47.648250 30783 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260806 17:01:47.651165 30798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:47.652570 30783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:01:47.652778 30783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "7c2cf086d87f4b6d86841a8924802458"
format_stamp: "Formatted at 2026-08-06 17:01:47 on dist-test-slave-cbsf"
server_key: "743bf006c230d1aeeb3168372438db9f"
server_key_iv: "23c0fd8a853b8f44e30e5dd9cb977c8f"
server_key_version: "encryptionkey@0"
I20260806 17:01:47.652922 30783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:47.658135 30783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:47.661793 30783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:47.662029 30783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:47.669713 30783 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46431
I20260806 17:01:47.669723 30858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46431 every 8 connection(s)
I20260806 17:01:47.670745 30783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:47.673841 30859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:47.674769 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30783
I20260806 17:01:47.674947 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:47.675257 7780 external_mini_cluster.cc:1428] Setting key 5e11da2ce81afb84c11b421d0e12f1b5
I20260806 17:01:47.680758 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:47.676783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:45217 (local address 127.0.0.1:46431)
0806 17:01:47.677283 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:47.677298 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:47.677335 (+ 37us) server_negotiation.cc:407] Connection header received
0806 17:01:47.677990 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:47.678008 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:47.678309 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:47.678674 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:47.679467 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:47.679472 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:47.679485 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:47.679495 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:47.679554 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:47.679573 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:47.679736 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:47.679808 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 17:01:47.679977 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":135,"threads_started":1}
I20260806 17:01:47.680835 30859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458: Bootstrap starting.
I20260806 17:01:47.683315 30859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:47.683706 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:47.684226 30859 log.cc:824] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:47.686595 30859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458: No bootstrap required, opened a new log
I20260806 17:01:47.687639 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:47.685889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.129:37809 (local address 127.0.0.1:46431)
0806 17:01:47.686025 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:47.686030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:47.686216 (+ 186us) server_negotiation.cc:407] Connection header received
0806 17:01:47.686362 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:47.686365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:47.686403 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:47.686485 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:47.687235 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:47.687239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:47.687241 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:47.687252 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:47.687280 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:47.687297 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:47.687399 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:47.687464 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 17:01:47.687510 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 17:01:47.690920 30859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2cf086d87f4b6d86841a8924802458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46431 } }
I20260806 17:01:47.691190 30859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:47.691249 30859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2cf086d87f4b6d86841a8924802458, State: Initialized, Role: FOLLOWER
I20260806 17:01:47.691726 30859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2cf086d87f4b6d86841a8924802458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46431 } }
I20260806 17:01:47.691877 30859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:47.691964 30859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:47.692091 30859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:47.693199 30859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2cf086d87f4b6d86841a8924802458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46431 } }
I20260806 17:01:47.693563 30859 leader_election.cc:302] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c2cf086d87f4b6d86841a8924802458; no voters:
I20260806 17:01:47.693912 30859 leader_election.cc:288] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:47.694041 30869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:47.694307 30869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [term 1 LEADER]: Becoming Leader. State: Replica: 7c2cf086d87f4b6d86841a8924802458, State: Running, Role: LEADER
I20260806 17:01:47.694676 30869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2cf086d87f4b6d86841a8924802458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46431 } }
I20260806 17:01:47.695258 30859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:47.696446 30870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c2cf086d87f4b6d86841a8924802458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2cf086d87f4b6d86841a8924802458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46431 } } }
I20260806 17:01:47.696583 30870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:47.697315 30871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c2cf086d87f4b6d86841a8924802458. Latest consensus state: current_term: 1 leader_uuid: "7c2cf086d87f4b6d86841a8924802458" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c2cf086d87f4b6d86841a8924802458" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46431 } } }
I20260806 17:01:47.697481 30871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458 [sys.catalog]: This master's current role is: LEADER
W20260806 17:01:47.700522 30884 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:47.700620 30884 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:47.700740 30878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:47.701525 30878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:47.707469 30878 catalog_manager.cc:1347] Generated new cluster ID: 12415a6dae574c9bbd48a6b02d900da9
I20260806 17:01:47.707625 30878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:47.725600 30878 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:47.726006 30878 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:47.731259 30878 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c2cf086d87f4b6d86841a8924802458: Generated new TSK 0
I20260806 17:01:47.732066 30878 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:47.742202 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30783
2026-08-06T17:01:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1489 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:47 dist-test-slave-cbsf krb5kdc[30891](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:47 dist-test-slave-cbsf krb5kdc[30891](info): set up 2 sockets
Aug 06 17:01:47 dist-test-slave-cbsf krb5kdc[30891](info): commencing operation
krb5kdc: starting...
W20260806 17:01:48.834299 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:48 dist-test-slave-cbsf krb5kdc[30891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:48.976683 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:36789
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:36789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:49.102272 30906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:49.102654 30906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:49.102742 30906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:49.107076 30906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:49.107220 30906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:49.107256 30906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:49.107296 30906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:49.107349 30906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:49.114341 30906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:36789
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:36789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:49.115734 30906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:49.116981 30906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:49.126822 30911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:49.126818 30914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:49.126827 30912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:49.127243 30906 server_base.cc:1034] running on GCE node
I20260806 17:01:49.127910 30906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:49.129232 30906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:49.130451 30906 hybrid_clock.cc:648] HybridClock initialized: now 1786035709130430 us; error 40 us; skew 500 ppm
Aug 06 17:01:49 dist-test-slave-cbsf krb5kdc[30891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035709, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:49.133702 30906 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:49.134773 30906 webserver.cc:460] Webserver started at http://127.7.153.62:42865/ using document root <none> and password file <none>
I20260806 17:01:49.135394 30906 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:49.135486 30906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:49.135733 30906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:49.138105 30906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "19029f3115db4785a598333364b333c0"
format_stamp: "Formatted at 2026-08-06 17:01:49 on dist-test-slave-cbsf"
server_key: "d5e6bba53e49c10354d71c7481fd34a8"
server_key_iv: "ec791c076530627df59b5f4aefcba16b"
server_key_version: "encryptionkey@0"
I20260806 17:01:49.138736 30906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "19029f3115db4785a598333364b333c0"
format_stamp: "Formatted at 2026-08-06 17:01:49 on dist-test-slave-cbsf"
server_key: "d5e6bba53e49c10354d71c7481fd34a8"
server_key_iv: "ec791c076530627df59b5f4aefcba16b"
server_key_version: "encryptionkey@0"
I20260806 17:01:49.142957 30906 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:01:49.145824 30922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:49.147187 30906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 17:01:49.147356 30906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "19029f3115db4785a598333364b333c0"
format_stamp: "Formatted at 2026-08-06 17:01:49 on dist-test-slave-cbsf"
server_key: "d5e6bba53e49c10354d71c7481fd34a8"
server_key_iv: "ec791c076530627df59b5f4aefcba16b"
server_key_version: "encryptionkey@0"
I20260806 17:01:49.147493 30906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:49.161693 30906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:49.165256 30906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:49.165514 30906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:49.173627 30906 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:36789
I20260806 17:01:49.173681 30977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:36789 every 8 connection(s)
I20260806 17:01:49.174815 30906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:49.175624 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 30906
I20260806 17:01:49.175784 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:49.176107 7780 external_mini_cluster.cc:1428] Setting key ffcc918f1463eb297efd365eabd71e82
I20260806 17:01:49.178663 30978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:49.186074 30978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0: Bootstrap starting.
Aug 06 17:01:49 dist-test-slave-cbsf krb5kdc[30891](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:49.189204 30978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:49.190178 30978 log.cc:824] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:49.192773 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:49.177659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44941 (local address 127.7.153.62:36789)
0806 17:01:49.178108 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:49.178139 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:49.178184 (+ 45us) server_negotiation.cc:407] Connection header received
0806 17:01:49.179072 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:49.179097 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:49.179558 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:49.179942 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:49.180792 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:49.182382 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:49.183357 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:49.184083 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:49.184263 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:49.187088 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:49.187095 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:49.187114 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:49.187153 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:49.189285 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:49.189895 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:49.189901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:49.189908 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:49.190086 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:49.190432 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:49.190435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:49.190437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:49.190966 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:49.191182 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:49.191531 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 17:01:49.191775 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":118,"threads_started":1}
I20260806 17:01:49.192845 30978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0: No bootstrap required, opened a new log
I20260806 17:01:49.196516 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:49.197650 30978 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19029f3115db4785a598333364b333c0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36789 } }
I20260806 17:01:49.198036 30978 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:49.198110 30978 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19029f3115db4785a598333364b333c0, State: Initialized, Role: FOLLOWER
I20260806 17:01:49.198957 30978 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19029f3115db4785a598333364b333c0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36789 } }
I20260806 17:01:49.199486 30978 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:49.199621 30978 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:49.199883 30978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:49.201565 30978 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19029f3115db4785a598333364b333c0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36789 } }
I20260806 17:01:49.202049 30978 leader_election.cc:302] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19029f3115db4785a598333364b333c0; no voters:
I20260806 17:01:49.202495 30978 leader_election.cc:288] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:49.202653 30988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:49.203118 30988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [term 1 LEADER]: Becoming Leader. State: Replica: 19029f3115db4785a598333364b333c0, State: Running, Role: LEADER
I20260806 17:01:49.203645 30988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19029f3115db4785a598333364b333c0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36789 } }
I20260806 17:01:49.204130 30978 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:49.205578 30989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19029f3115db4785a598333364b333c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19029f3115db4785a598333364b333c0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36789 } } }
I20260806 17:01:49.205720 30989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:49.206300 30997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:49.206143 30990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19029f3115db4785a598333364b333c0. Latest consensus state: current_term: 1 leader_uuid: "19029f3115db4785a598333364b333c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19029f3115db4785a598333364b333c0" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36789 } } }
I20260806 17:01:49.207213 30990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:49.209568 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:49.199249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54409 (local address 127.7.153.62:36789)
0806 17:01:49.199481 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:49.199488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:49.199932 (+ 444us) server_negotiation.cc:407] Connection header received
0806 17:01:49.200155 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:49.200158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:49.200209 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:49.200289 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:49.201307 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:49.201941 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:49.203143 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:49.203498 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:49.203608 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:49.205647 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:49.205651 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:49.205654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:49.205681 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:49.207497 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:49.208050 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:49.208054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:49.208056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:49.208142 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:49.208490 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:49.208494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:49.208496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:49.208813 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:49.208962 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:49.209293 (+ 331us) server_negotiation.cc:299] Negotiation successful
0806 17:01:49.209405 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 17:01:49.210777 30997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:49.217404 30997 catalog_manager.cc:1347] Generated new cluster ID: 7bdfa3fcd5934d33bd7cd4faa07fcd68
I20260806 17:01:49.217521 30997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:49.228461 30997 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:49.229871 30997 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:49.239850 30997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19029f3115db4785a598333364b333c0: Generated new TSK 0
I20260806 17:01:49.240897 30997 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:49.247219 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 30906
W20260806 17:01:49.256429 30889 connection.cc:535] client connection to 127.7.153.62:36789 recv error: Network error: failed to read from TLS socket (remote: 127.7.153.62:36789): Connection reset by peer (error 104)
2026-08-06T17:01:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1506 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:49 dist-test-slave-cbsf krb5kdc[31009](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:49 dist-test-slave-cbsf krb5kdc[31009](info): set up 2 sockets
Aug 06 17:01:49 dist-test-slave-cbsf krb5kdc[31009](info): commencing operation
krb5kdc: starting...
W20260806 17:01:50.355211 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:50 dist-test-slave-cbsf krb5kdc[31009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:50.501123 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:45055
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:33157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:45055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:50.626096 31024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:50.626447 31024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:50.626497 31024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:50.630975 31024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:50.631067 31024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:50.631088 31024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:50.631106 31024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:50.631122 31024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:50.637025 31024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:33157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:45055
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:45055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:50.638346 31024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:50.639495 31024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:50.648898 31033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:50.648926 31030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:50.648911 31031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:50.649005 31024 server_base.cc:1034] running on GCE node
I20260806 17:01:50.649770 31024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:50.651078 31024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:50.652277 31024 hybrid_clock.cc:648] HybridClock initialized: now 1786035710652240 us; error 55 us; skew 500 ppm
Aug 06 17:01:50 dist-test-slave-cbsf krb5kdc[31009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035710, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:50.655578 31024 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:50.656762 31024 webserver.cc:460] Webserver started at http://127.7.153.62:44931/ using document root <none> and password file <none>
I20260806 17:01:50.657442 31024 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:50.657513 31024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:50.657752 31024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:50.660120 31024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "6cbd437b11f545ddb3d300f6758b6cf4"
format_stamp: "Formatted at 2026-08-06 17:01:50 on dist-test-slave-cbsf"
server_key: "cdf1550a7ec9c4519cebb3fc0fdb5b96"
server_key_iv: "b56b8a9fe8541c9773403c6037a5885a"
server_key_version: "encryptionkey@0"
I20260806 17:01:50.660822 31024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "6cbd437b11f545ddb3d300f6758b6cf4"
format_stamp: "Formatted at 2026-08-06 17:01:50 on dist-test-slave-cbsf"
server_key: "cdf1550a7ec9c4519cebb3fc0fdb5b96"
server_key_iv: "b56b8a9fe8541c9773403c6037a5885a"
server_key_version: "encryptionkey@0"
I20260806 17:01:50.665154 31024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 17:01:50.667977 31042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:50.669605 31024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:50.669782 31024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "6cbd437b11f545ddb3d300f6758b6cf4"
format_stamp: "Formatted at 2026-08-06 17:01:50 on dist-test-slave-cbsf"
server_key: "cdf1550a7ec9c4519cebb3fc0fdb5b96"
server_key_iv: "b56b8a9fe8541c9773403c6037a5885a"
server_key_version: "encryptionkey@0"
I20260806 17:01:50.669921 31024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:50.692503 31024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:50.696172 31024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:50.696430 31024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:50.705129 31024 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:45055
I20260806 17:01:50.705149 31098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:45055 every 8 connection(s)
I20260806 17:01:50.706244 31024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:50.709638 31099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:50.710115 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31024
I20260806 17:01:50.710279 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:50.710577 7780 external_mini_cluster.cc:1428] Setting key e7db7f2054e3ee7bb6c199d625f171bc
I20260806 17:01:50.718588 31099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4: Bootstrap starting.
I20260806 17:01:50.722093 31099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:50.722842 31102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:50.712146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60403 (local address 127.7.153.62:45055)
0806 17:01:50.712648 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:50.712673 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:50.712773 (+ 100us) server_negotiation.cc:407] Connection header received
0806 17:01:50.713730 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:50.713761 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:50.714295 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:50.714748 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:50.715228 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:50.717020 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:50.718128 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:50.718962 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:50.719159 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:50.720382 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:50.720390 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:50.720410 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:50.721031 (+ 621us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:50.721120 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:50.721157 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:50.721313 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:50.721531 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 17:01:50.721698 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":130,"threads_started":1}
I20260806 17:01:50.723160 31099 log.cc:824] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:50.725786 31099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4: No bootstrap required, opened a new log
I20260806 17:01:50.726377 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:50.730487 31099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45055 } }
I20260806 17:01:50.730885 31099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:50.730969 31099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cbd437b11f545ddb3d300f6758b6cf4, State: Initialized, Role: FOLLOWER
I20260806 17:01:50.731503 31099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45055 } }
I20260806 17:01:50.731688 31099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:50.731769 31099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:50.731886 31099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:50.733496 31099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45055 } }
I20260806 17:01:50.733662 31102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:50.728733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52129 (local address 127.7.153.62:45055)
0806 17:01:50.728891 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:50.728897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:50.729163 (+ 266us) server_negotiation.cc:407] Connection header received
0806 17:01:50.729275 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:50.729278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:50.729342 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:50.729452 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:50.729724 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:50.730512 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:50.731530 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:50.731917 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:50.732059 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:50.733082 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:50.733086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:50.733090 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:50.733107 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:50.733140 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:50.733157 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:50.733278 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:50.733457 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 17:01:50.733505 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 17:01:50.733954 31099 leader_election.cc:302] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cbd437b11f545ddb3d300f6758b6cf4; no voters:
I20260806 17:01:50.734390 31099 leader_election.cc:288] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:50.734517 31110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:50.734803 31110 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 6cbd437b11f545ddb3d300f6758b6cf4, State: Running, Role: LEADER
I20260806 17:01:50.735263 31110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45055 } }
I20260806 17:01:50.735885 31099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:50.737212 31112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cbd437b11f545ddb3d300f6758b6cf4. Latest consensus state: current_term: 1 leader_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45055 } } }
I20260806 17:01:50.737391 31112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:50.737746 31111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cbd437b11f545ddb3d300f6758b6cf4" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 45055 } } }
I20260806 17:01:50.737847 31119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:50.737951 31111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:50.741811 31119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:50.748625 31119 catalog_manager.cc:1347] Generated new cluster ID: 0e23fae88ac242a4813415dcef83a41b
I20260806 17:01:50.748766 31119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:50.768894 31119 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:50.770018 31119 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:50.778450 31119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cbd437b11f545ddb3d300f6758b6cf4: Generated new TSK 0
I20260806 17:01:50.779265 31119 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:50.787729 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31024
W20260806 17:01:50.796413 31007 connection.cc:535] client connection to 127.7.153.62:45055 recv error: Network error: failed to read from TLS socket (remote: 127.7.153.62:45055): Connection reset by peer (error 104)
2026-08-06T17:01:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:50 dist-test-slave-cbsf krb5kdc[31133](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:50 dist-test-slave-cbsf krb5kdc[31133](info): set up 2 sockets
Aug 06 17:01:50 dist-test-slave-cbsf krb5kdc[31133](info): commencing operation
krb5kdc: starting...
W20260806 17:01:51.893421 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:51 dist-test-slave-cbsf krb5kdc[31133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:52.036548 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:38455
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:41591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:38455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:52.161659 31149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:52.162014 31149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:52.162060 31149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:52.166618 31149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:52.166718 31149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:52.166739 31149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:52.166759 31149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:52.166774 31149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:52.173278 31149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:41591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:38455
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:38455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:52.174710 31149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:52.175921 31149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:52.186329 31154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:52.186329 31155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:52.186668 31149 server_base.cc:1034] running on GCE node
W20260806 17:01:52.186916 31157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:52.187597 31149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:52.189054 31149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:52.190281 31149 hybrid_clock.cc:648] HybridClock initialized: now 1786035712190263 us; error 41 us; skew 500 ppm
Aug 06 17:01:52 dist-test-slave-cbsf krb5kdc[31133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035712, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:52.198730 31149 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:52.199963 31149 webserver.cc:460] Webserver started at http://127.7.153.62:42275/ using document root <none> and password file <none>
I20260806 17:01:52.200632 31149 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:52.200763 31149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:52.201030 31149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:52.203342 31149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e"
format_stamp: "Formatted at 2026-08-06 17:01:52 on dist-test-slave-cbsf"
server_key: "a17126fa5d4317f22febd30b9fbc7bd3"
server_key_iv: "f3d0e3aedf8c71539398421f8a01f1a5"
server_key_version: "encryptionkey@0"
I20260806 17:01:52.204015 31149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e"
format_stamp: "Formatted at 2026-08-06 17:01:52 on dist-test-slave-cbsf"
server_key: "a17126fa5d4317f22febd30b9fbc7bd3"
server_key_iv: "f3d0e3aedf8c71539398421f8a01f1a5"
server_key_version: "encryptionkey@0"
I20260806 17:01:52.208400 31149 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 17:01:52.211371 31165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:52.212919 31149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:52.213080 31149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e"
format_stamp: "Formatted at 2026-08-06 17:01:52 on dist-test-slave-cbsf"
server_key: "a17126fa5d4317f22febd30b9fbc7bd3"
server_key_iv: "f3d0e3aedf8c71539398421f8a01f1a5"
server_key_version: "encryptionkey@0"
I20260806 17:01:52.213235 31149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:52.218415 31149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:52.222132 31149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:52.222369 31149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:52.230398 31149 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:38455
I20260806 17:01:52.230418 31223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:38455 every 8 connection(s)
I20260806 17:01:52.231578 31149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:52.235080 31224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:52.235204 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31149
I20260806 17:01:52.235319 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:52.235659 7780 external_mini_cluster.cc:1428] Setting key 8b5b0cd077693dd805c1f921b59651f9
I20260806 17:01:52.242051 31227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:52.237367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52231 (local address 127.7.153.62:38455)
0806 17:01:52.237914 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:52.237931 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:52.237972 (+ 41us) server_negotiation.cc:407] Connection header received
0806 17:01:52.238863 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:52.238887 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:52.239232 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:52.239675 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:52.240606 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:52.240611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:52.240625 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:52.240638 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:52.240752 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:52.240797 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:52.240977 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:52.241060 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 17:01:52.241249 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":170,"threads_started":1}
I20260806 17:01:52.242933 31224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e: Bootstrap starting.
I20260806 17:01:52.245309 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:52.245639 31224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:52.246409 31224 log.cc:824] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:52.249076 31224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e: No bootstrap required, opened a new log
I20260806 17:01:52.249890 31227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:52.247833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52757 (local address 127.7.153.62:38455)
0806 17:01:52.247964 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:52.247969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:52.248123 (+ 154us) server_negotiation.cc:407] Connection header received
0806 17:01:52.248231 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:52.248234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:52.248272 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:52.248359 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:52.249390 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:52.249393 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:52.249396 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:52.249409 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:52.249443 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:52.249458 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:52.249575 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:52.249723 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 17:01:52.249765 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 17:01:52.253350 31224 raft_consensus.cc:348] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38455 } }
I20260806 17:01:52.253647 31224 raft_consensus.cc:374] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:52.253708 31224 raft_consensus.cc:729] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c916d69bbd2c4ba0b6aa60e421eafa5e, State: Initialized, Role: FOLLOWER
I20260806 17:01:52.254184 31224 consensus_queue.cc:260] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38455 } }
I20260806 17:01:52.254336 31224 raft_consensus.cc:388] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:52.254410 31224 raft_consensus.cc:482] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:52.254523 31224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:52.255638 31224 raft_consensus.cc:504] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38455 } }
I20260806 17:01:52.256032 31224 leader_election.cc:302] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c916d69bbd2c4ba0b6aa60e421eafa5e; no voters:
I20260806 17:01:52.256430 31224 leader_election.cc:288] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:52.256582 31235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:52.256963 31235 raft_consensus.cc:686] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [term 1 LEADER]: Becoming Leader. State: Replica: c916d69bbd2c4ba0b6aa60e421eafa5e, State: Running, Role: LEADER
I20260806 17:01:52.257299 31235 consensus_queue.cc:237] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38455 } }
I20260806 17:01:52.257923 31224 sys_catalog.cc:564] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:52.258579 31235 sys_catalog.cc:455] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c916d69bbd2c4ba0b6aa60e421eafa5e. Latest consensus state: current_term: 1 leader_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38455 } } }
I20260806 17:01:52.258697 31235 sys_catalog.cc:458] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:52.259080 31241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:52.259114 31236 sys_catalog.cc:455] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c916d69bbd2c4ba0b6aa60e421eafa5e" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 38455 } } }
I20260806 17:01:52.260033 31236 sys_catalog.cc:458] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:52.263098 31241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:52.270318 31241 catalog_manager.cc:1347] Generated new cluster ID: 7e8b8ba25b17474e9231b72710cfb2cf
I20260806 17:01:52.270426 31241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:52.297191 31241 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:52.297629 31241 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:52.304124 31241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c916d69bbd2c4ba0b6aa60e421eafa5e: Generated new TSK 0
I20260806 17:01:52.305069 31241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:52.315181 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31149
2026-08-06T17:01:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1526 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:52 dist-test-slave-cbsf krb5kdc[31257](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:52 dist-test-slave-cbsf krb5kdc[31257](info): set up 2 sockets
Aug 06 17:01:52 dist-test-slave-cbsf krb5kdc[31257](info): commencing operation
krb5kdc: starting...
W20260806 17:01:53.421491 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:53 dist-test-slave-cbsf krb5kdc[31257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:53.568809 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37137
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:37137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:53.692283 31270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:53.692608 31270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:53.692653 31270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:53.697047 31270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:53.697126 31270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:53.697146 31270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:53.697181 31270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:53.697197 31270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:53.703472 31270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:37137
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:37137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:53.704763 31270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:53.705862 31270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:53.715341 31276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:53.715330 31278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:53.715330 31275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:53.715883 31270 server_base.cc:1034] running on GCE node
I20260806 17:01:53.716552 31270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:53.717923 31270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:53.719164 31270 hybrid_clock.cc:648] HybridClock initialized: now 1786035713719135 us; error 47 us; skew 500 ppm
Aug 06 17:01:53 dist-test-slave-cbsf krb5kdc[31257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035713, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:53.722299 31270 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:53.723403 31270 webserver.cc:460] Webserver started at http://127.7.153.62:36975/ using document root <none> and password file <none>
I20260806 17:01:53.724035 31270 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:53.724143 31270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:53.724414 31270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:53.726884 31270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "9d98d4dd4f0d40b39890d92c50b2b931"
format_stamp: "Formatted at 2026-08-06 17:01:53 on dist-test-slave-cbsf"
server_key: "55bda946555e54395e62cc70f19251e9"
server_key_iv: "074d83d0d5d1e7b6b038137e6a831c91"
server_key_version: "encryptionkey@0"
I20260806 17:01:53.727520 31270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "9d98d4dd4f0d40b39890d92c50b2b931"
format_stamp: "Formatted at 2026-08-06 17:01:53 on dist-test-slave-cbsf"
server_key: "55bda946555e54395e62cc70f19251e9"
server_key_iv: "074d83d0d5d1e7b6b038137e6a831c91"
server_key_version: "encryptionkey@0"
I20260806 17:01:53.731824 31270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 17:01:53.734766 31289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:53.736268 31270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:01:53.736436 31270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "9d98d4dd4f0d40b39890d92c50b2b931"
format_stamp: "Formatted at 2026-08-06 17:01:53 on dist-test-slave-cbsf"
server_key: "55bda946555e54395e62cc70f19251e9"
server_key_iv: "074d83d0d5d1e7b6b038137e6a831c91"
server_key_version: "encryptionkey@0"
I20260806 17:01:53.736578 31270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:53.750852 31270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:53.754432 31270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:53.754686 31270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:53.762627 31270 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:37137
I20260806 17:01:53.762657 31346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:37137 every 8 connection(s)
I20260806 17:01:53.763702 31270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:53.766955 31347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:53.768028 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31270
I20260806 17:01:53.768195 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:53.768530 7780 external_mini_cluster.cc:1428] Setting key 7f97836c7f747e137448e65adbb87bc3
I20260806 17:01:53.774366 31347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931: Bootstrap starting.
I20260806 17:01:53.777529 31347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931: Neither blocks nor log segments found. Creating new log.
Aug 06 17:01:53 dist-test-slave-cbsf krb5kdc[31257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:53.778450 31347 log.cc:824] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:53.780898 31347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931: No bootstrap required, opened a new log
I20260806 17:01:53.784170 31351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:53.770053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56973 (local address 127.7.153.62:37137)
0806 17:01:53.770530 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:53.770547 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:53.770584 (+ 37us) server_negotiation.cc:407] Connection header received
0806 17:01:53.771247 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:53.771263 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:53.771648 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:53.771936 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:53.772930 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:53.773968 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:53.775113 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:53.775604 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:53.775731 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:53.778805 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:53.778812 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:53.778833 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:53.778872 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:53.780813 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:53.781419 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:53.781425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:53.781431 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:53.781590 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:53.781923 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:53.781926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:53.781927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:53.782430 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:53.782624 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:53.782949 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 17:01:53.783289 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":158,"threads_started":1}
I20260806 17:01:53.785337 31347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37137 } }
I20260806 17:01:53.785610 31347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:53.785691 31347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d98d4dd4f0d40b39890d92c50b2b931, State: Initialized, Role: FOLLOWER
I20260806 17:01:53.786144 31347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37137 } }
I20260806 17:01:53.786298 31347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:53.786388 31347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:53.786510 31347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:53.787668 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:53.787845 31347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37137 } }
I20260806 17:01:53.788229 31347 leader_election.cc:302] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d98d4dd4f0d40b39890d92c50b2b931; no voters:
I20260806 17:01:53.788622 31347 leader_election.cc:288] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:53.788812 31353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:53.789083 31353 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [term 1 LEADER]: Becoming Leader. State: Replica: 9d98d4dd4f0d40b39890d92c50b2b931, State: Running, Role: LEADER
I20260806 17:01:53.789499 31353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37137 } }
I20260806 17:01:53.790242 31347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:53.790930 31353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d98d4dd4f0d40b39890d92c50b2b931. Latest consensus state: current_term: 1 leader_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37137 } } }
I20260806 17:01:53.791082 31353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:53.791675 31355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d98d4dd4f0d40b39890d92c50b2b931" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 37137 } } }
I20260806 17:01:53.791846 31355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931 [sys.catalog]: This master's current role is: LEADER
W20260806 17:01:53.795847 31375 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:53.795994 31375 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:53.796089 31365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:53.797066 31365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:53.801220 31351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:53.790491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46445 (local address 127.7.153.62:37137)
0806 17:01:53.790629 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:53.790634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:53.791526 (+ 892us) server_negotiation.cc:407] Connection header received
0806 17:01:53.791764 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:53.791769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:53.791830 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:53.791917 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:53.793071 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:53.793877 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:53.794943 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:53.795211 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:53.795346 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:53.797074 (+ 1728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:53.797078 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:53.797081 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:53.797139 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:53.798875 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:53.799509 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:53.799513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:53.799515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:53.799632 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:53.800012 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:53.800017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:53.800020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:53.800337 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:53.800484 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:53.800873 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 17:01:53.801023 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 17:01:53.804607 31365 catalog_manager.cc:1347] Generated new cluster ID: 7ec514c368e64ba992bbd83cb8b1395e
I20260806 17:01:53.804741 31365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:53.822723 31365 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:53.824126 31365 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:53.843323 31365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d98d4dd4f0d40b39890d92c50b2b931: Generated new TSK 0
I20260806 17:01:53.844213 31365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:53.851022 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31270
2026-08-06T17:01:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:53 dist-test-slave-cbsf krb5kdc[31382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:53 dist-test-slave-cbsf krb5kdc[31382](info): set up 2 sockets
Aug 06 17:01:53 dist-test-slave-cbsf krb5kdc[31382](info): commencing operation
krb5kdc: starting...
W20260806 17:01:54.941615 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:55 dist-test-slave-cbsf krb5kdc[31382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:55.092878 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:36773
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:36773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:55.229401 31396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:55.229797 31396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:55.229897 31396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:55.235028 31396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:55.235222 31396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:55.235267 31396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:55.235307 31396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:55.235363 31396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:55.243376 31396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:36773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:36773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:55.244830 31396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:55.246290 31396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:55.258574 31402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:55.258625 31401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:55.258781 31396 server_base.cc:1034] running on GCE node
W20260806 17:01:55.258558 31404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:55.259980 31396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:55.261483 31396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:55.262681 31396 hybrid_clock.cc:648] HybridClock initialized: now 1786035715262650 us; error 50 us; skew 500 ppm
Aug 06 17:01:55 dist-test-slave-cbsf krb5kdc[31382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035715, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:55.266533 31396 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:55.268100 31396 webserver.cc:460] Webserver started at http://127.7.153.62:44849/ using document root <none> and password file <none>
I20260806 17:01:55.269075 31396 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:55.269169 31396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:55.269435 31396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:55.272272 31396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c0ad8d628b05402196acf5c9481d1682"
format_stamp: "Formatted at 2026-08-06 17:01:55 on dist-test-slave-cbsf"
server_key: "47d652bc6fbc9dc7e1c5e3777547b312"
server_key_iv: "cfc4913615f10d3e53e0182ff8e4e131"
server_key_version: "encryptionkey@0"
I20260806 17:01:55.273032 31396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c0ad8d628b05402196acf5c9481d1682"
format_stamp: "Formatted at 2026-08-06 17:01:55 on dist-test-slave-cbsf"
server_key: "47d652bc6fbc9dc7e1c5e3777547b312"
server_key_iv: "cfc4913615f10d3e53e0182ff8e4e131"
server_key_version: "encryptionkey@0"
I20260806 17:01:55.278117 31396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 17:01:55.281731 31412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:55.283856 31396 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:55.284124 31396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c0ad8d628b05402196acf5c9481d1682"
format_stamp: "Formatted at 2026-08-06 17:01:55 on dist-test-slave-cbsf"
server_key: "47d652bc6fbc9dc7e1c5e3777547b312"
server_key_iv: "cfc4913615f10d3e53e0182ff8e4e131"
server_key_version: "encryptionkey@0"
I20260806 17:01:55.284291 31396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:55.311412 31396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:55.315209 31396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:55.315474 31396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:55.323977 31396 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:36773
I20260806 17:01:55.324083 31469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:36773 every 8 connection(s)
I20260806 17:01:55.325218 31396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:55.328306 31471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:55.333074 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31396
I20260806 17:01:55.333235 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:55.333542 7780 external_mini_cluster.cc:1428] Setting key 6dfc78964596b7edcbefc95d5f6d9938
I20260806 17:01:55.335601 31471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682: Bootstrap starting.
I20260806 17:01:55.338296 31471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:55.339231 31471 log.cc:824] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:55.341938 31471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682: No bootstrap required, opened a new log
I20260806 17:01:55.343689 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:55.335243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43021 (local address 127.7.153.62:36773)
0806 17:01:55.335705 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:55.335721 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:55.335757 (+ 36us) server_negotiation.cc:407] Connection header received
0806 17:01:55.336485 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:55.336504 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:55.336982 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:55.337297 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:55.337648 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:55.338728 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:55.339929 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:55.340677 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:55.340886 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:55.341799 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:55.341804 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:55.341819 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:55.342290 (+ 471us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:55.342353 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:55.342378 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:55.342494 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:55.342682 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 17:01:55.342910 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":160,"threads_started":1}
I20260806 17:01:55.346359 31471 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ad8d628b05402196acf5c9481d1682" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36773 } }
I20260806 17:01:55.346665 31471 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:55.346761 31471 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0ad8d628b05402196acf5c9481d1682, State: Initialized, Role: FOLLOWER
I20260806 17:01:55.346817 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:55.347306 31471 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ad8d628b05402196acf5c9481d1682" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36773 } }
I20260806 17:01:55.347499 31471 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:55.347596 31471 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:55.347734 31471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:55.349261 31471 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ad8d628b05402196acf5c9481d1682" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36773 } }
I20260806 17:01:55.349713 31471 leader_election.cc:302] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0ad8d628b05402196acf5c9481d1682; no voters:
I20260806 17:01:55.350134 31471 leader_election.cc:288] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:55.350221 31481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:55.350455 31481 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [term 1 LEADER]: Becoming Leader. State: Replica: c0ad8d628b05402196acf5c9481d1682, State: Running, Role: LEADER
I20260806 17:01:55.350831 31481 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ad8d628b05402196acf5c9481d1682" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36773 } }
I20260806 17:01:55.351766 31471 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:55.353452 31483 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0ad8d628b05402196acf5c9481d1682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ad8d628b05402196acf5c9481d1682" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36773 } } }
I20260806 17:01:55.353657 31483 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:55.353999 31482 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ad8d628b05402196acf5c9481d1682. Latest consensus state: current_term: 1 leader_uuid: "c0ad8d628b05402196acf5c9481d1682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ad8d628b05402196acf5c9481d1682" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 36773 } } }
I20260806 17:01:55.354110 31482 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:55.354329 31490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:55.357864 31490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:55.360198 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:55.349216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38271 (local address 127.7.153.62:36773)
0806 17:01:55.349404 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:55.349408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:55.355146 (+ 5738us) server_negotiation.cc:407] Connection header received
0806 17:01:55.355322 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:55.355326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:55.355387 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:55.355511 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:55.355825 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:55.356606 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:55.357905 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:55.358222 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:55.358326 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:55.359450 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:55.359457 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:55.359461 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:55.359478 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:55.359511 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:55.359526 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:55.359595 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:55.359967 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 17:01:55.360050 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 17:01:55.364606 31490 catalog_manager.cc:1347] Generated new cluster ID: 7b413603f3a94678bff241e43fa961ac
I20260806 17:01:55.364771 31490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:55.371932 31490 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:55.373423 31490 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:55.386770 31490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0ad8d628b05402196acf5c9481d1682: Generated new TSK 0
I20260806 17:01:55.387666 31490 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:55.393074 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31396
2026-08-06T17:01:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1542 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:55 dist-test-slave-cbsf krb5kdc[31503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:55 dist-test-slave-cbsf krb5kdc[31503](info): set up 2 sockets
Aug 06 17:01:55 dist-test-slave-cbsf krb5kdc[31503](info): commencing operation
krb5kdc: starting...
W20260806 17:01:56.497514 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:56 dist-test-slave-cbsf krb5kdc[31503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:56.644624 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44799
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:41283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:44799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:56.776289 31518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:56.776681 31518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:56.776785 31518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:56.781172 31518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:56.781297 31518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:56.781334 31518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:56.781378 31518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:56.781417 31518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:56.787290 31518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:41283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:44799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:44799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:56.788574 31518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:56.789710 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:56.799259 31527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:56.799259 31525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:56.799433 31524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:56.799731 31518 server_base.cc:1034] running on GCE node
I20260806 17:01:56.800854 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:56.802206 31518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:56.803406 31518 hybrid_clock.cc:648] HybridClock initialized: now 1786035716803378 us; error 50 us; skew 500 ppm
Aug 06 17:01:56 dist-test-slave-cbsf krb5kdc[31503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035716, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:56.806773 31518 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:56.807894 31518 webserver.cc:460] Webserver started at http://127.7.153.62:39979/ using document root <none> and password file <none>
I20260806 17:01:56.808535 31518 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:56.808605 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:56.808882 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:56.811218 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "df4ecfbca84b4fbf85fa4945a0875634"
format_stamp: "Formatted at 2026-08-06 17:01:56 on dist-test-slave-cbsf"
server_key: "1b227300f4fb9b00c748a28b67fd7b13"
server_key_iv: "97a61de0753aeb1f097a1745523e3bb3"
server_key_version: "encryptionkey@0"
I20260806 17:01:56.811851 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "df4ecfbca84b4fbf85fa4945a0875634"
format_stamp: "Formatted at 2026-08-06 17:01:56 on dist-test-slave-cbsf"
server_key: "1b227300f4fb9b00c748a28b67fd7b13"
server_key_iv: "97a61de0753aeb1f097a1745523e3bb3"
server_key_version: "encryptionkey@0"
I20260806 17:01:56.816531 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 17:01:56.819659 31534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:56.821264 31518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:56.821448 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "df4ecfbca84b4fbf85fa4945a0875634"
format_stamp: "Formatted at 2026-08-06 17:01:56 on dist-test-slave-cbsf"
server_key: "1b227300f4fb9b00c748a28b67fd7b13"
server_key_iv: "97a61de0753aeb1f097a1745523e3bb3"
server_key_version: "encryptionkey@0"
I20260806 17:01:56.821596 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:56.826897 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:56.830525 31518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:56.830760 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:56.839278 31518 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:44799
I20260806 17:01:56.839313 31590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:44799 every 8 connection(s)
I20260806 17:01:56.840389 31518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:56.843564 31591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:56.844805 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31518
I20260806 17:01:56.844960 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:56.845325 7780 external_mini_cluster.cc:1428] Setting key 3108592aded1b12aed6288a14dd75139
I20260806 17:01:56.851198 31594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:56.846918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53347 (local address 127.7.153.62:44799)
0806 17:01:56.847455 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:56.847472 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:56.847513 (+ 41us) server_negotiation.cc:407] Connection header received
0806 17:01:56.848229 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:56.848248 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:56.848569 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:56.849043 (+ 474us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:56.849876 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:56.849882 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:56.849895 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:56.849907 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:56.849964 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:56.849985 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:56.850157 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:56.850235 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 17:01:56.850421 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":174,"threads_started":1}
I20260806 17:01:56.851711 31591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634: Bootstrap starting.
I20260806 17:01:56.854660 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:56.854756 31591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:56.855551 31591 log.cc:824] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:56.858253 31591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634: No bootstrap required, opened a new log
I20260806 17:01:56.859510 31594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:56.857245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37135 (local address 127.7.153.62:44799)
0806 17:01:56.857391 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:56.857396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:56.857580 (+ 184us) server_negotiation.cc:407] Connection header received
0806 17:01:56.857693 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:56.857696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:56.857733 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:56.857836 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:56.858999 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:56.859003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:56.859006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 17:01:56.859020 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:56.859055 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 17:01:56.859068 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:56.859196 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:56.859340 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 17:01:56.859384 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 17:01:56.863216 31591 raft_consensus.cc:348] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4ecfbca84b4fbf85fa4945a0875634" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44799 } }
I20260806 17:01:56.863595 31591 raft_consensus.cc:374] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 17:01:56.863636 31591 raft_consensus.cc:729] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4ecfbca84b4fbf85fa4945a0875634, State: Initialized, Role: FOLLOWER
I20260806 17:01:56.864169 31591 consensus_queue.cc:260] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4ecfbca84b4fbf85fa4945a0875634" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44799 } }
I20260806 17:01:56.864328 31591 raft_consensus.cc:388] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 17:01:56.864387 31591 raft_consensus.cc:482] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 17:01:56.864470 31591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:56.865854 31591 raft_consensus.cc:504] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4ecfbca84b4fbf85fa4945a0875634" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44799 } }
I20260806 17:01:56.866300 31591 leader_election.cc:302] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df4ecfbca84b4fbf85fa4945a0875634; no voters:
I20260806 17:01:56.866777 31591 leader_election.cc:288] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 17:01:56.867087 31601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:56.867415 31601 raft_consensus.cc:686] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [term 1 LEADER]: Becoming Leader. State: Replica: df4ecfbca84b4fbf85fa4945a0875634, State: Running, Role: LEADER
I20260806 17:01:56.867871 31601 consensus_queue.cc:237] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4ecfbca84b4fbf85fa4945a0875634" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44799 } }
I20260806 17:01:56.868584 31591 sys_catalog.cc:564] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:56.869951 31602 sys_catalog.cc:455] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df4ecfbca84b4fbf85fa4945a0875634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4ecfbca84b4fbf85fa4945a0875634" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44799 } } }
I20260806 17:01:56.869951 31603 sys_catalog.cc:455] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df4ecfbca84b4fbf85fa4945a0875634. Latest consensus state: current_term: 1 leader_uuid: "df4ecfbca84b4fbf85fa4945a0875634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df4ecfbca84b4fbf85fa4945a0875634" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 44799 } } }
I20260806 17:01:56.870142 31602 sys_catalog.cc:458] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:56.870142 31603 sys_catalog.cc:458] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:56.870654 31611 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:56.874245 31611 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:56.880841 31611 catalog_manager.cc:1347] Generated new cluster ID: a69a4c8a79fb454994d2be7068453f4c
I20260806 17:01:56.880941 31611 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:56.891404 31611 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:56.891840 31611 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:56.897639 31611 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df4ecfbca84b4fbf85fa4945a0875634: Generated new TSK 0
I20260806 17:01:56.898587 31611 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 17:01:56.906224 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31518
2026-08-06T17:01:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1511 ms)
[----------] 18 tests from AuthTokenIssuingTest (27552 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:01:56 dist-test-slave-cbsf krb5kdc[31624](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:01:56 dist-test-slave-cbsf krb5kdc[31624](info): set up 2 sockets
Aug 06 17:01:56 dist-test-slave-cbsf krb5kdc[31624](info): commencing operation
krb5kdc: starting...
W20260806 17:01:58.027046 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:01:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:01:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:01:58.176393 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34903
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34903,127.7.153.61:35251,127.7.153.60:46367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:01:58.298887 31637 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 17:01:58.299257 31637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:58.299283 31637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:58.299324 31637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:58.303646 31637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:58.303735 31637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:58.303755 31637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:58.303773 31637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:58.303789 31637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:58.309790 31637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34903,127.7.153.61:35251,127.7.153.60:46367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:34903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:58.311020 31637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:58.312067 31637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:58.321684 31643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:58.321684 31645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:58.321687 31642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:58.322019 31637 server_base.cc:1034] running on GCE node
I20260806 17:01:58.322866 31637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:58.324138 31637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:58.325359 31637 hybrid_clock.cc:648] HybridClock initialized: now 1786035718325316 us; error 60 us; skew 500 ppm
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:58.328581 31637 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:01:58.329715 31637 webserver.cc:460] Webserver started at http://127.7.153.62:45381/ using document root <none> and password file <none>
I20260806 17:01:58.330386 31637 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:58.330488 31637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:58.330744 31637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:58.333253 31637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "c8fbe0913f6f4b58b55918f8adbcfa23"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "ffdc9e58a3a1f028e7ef0915e2673a72"
server_key_iv: "4017e17edf5846b39f5a86c677863aad"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.333873 31637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "c8fbe0913f6f4b58b55918f8adbcfa23"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "ffdc9e58a3a1f028e7ef0915e2673a72"
server_key_iv: "4017e17edf5846b39f5a86c677863aad"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.338120 31637 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 17:01:58.340948 31654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:58.342375 31637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:58.342550 31637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "c8fbe0913f6f4b58b55918f8adbcfa23"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "ffdc9e58a3a1f028e7ef0915e2673a72"
server_key_iv: "4017e17edf5846b39f5a86c677863aad"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.342693 31637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:58.368427 31637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:58.373731 31637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:58.374042 31637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:58.382150 31637 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:34903
I20260806 17:01:58.382488 31709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:34903 every 8 connection(s)
I20260806 17:01:58.383312 31637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:01:58.385365 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31637
I20260806 17:01:58.385526 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:01:58.385838 7780 external_mini_cluster.cc:1428] Setting key d5f6b472898bda02cdc5233fc84d1058
I20260806 17:01:58.386934 31710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:58.391815 31710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.153.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.61@KRBTEST.COM" created.
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:58.410454 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.394464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34903 (local address 127.0.0.1:40526)
0806 17:01:58.395061 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.395119 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.396048 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.396932 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.396937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.397319 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.397679 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.397697 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.399283 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.399290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.400812 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.400830 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.401863 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.401866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.402039 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.402719 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.402738 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.404845 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.407126 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.407138 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.407153 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.407511 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.407904 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.407907 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.407909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.408098 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.408862 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.408871 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.409020 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.409188 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.409584 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":130,"thread_start_us":184,"threads_started":1}
I20260806 17:01:58.410451 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.394464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.7.153.62:34903)
0806 17:01:58.395162 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.395173 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.395227 (+ 54us) server_negotiation.cc:407] Connection header received
0806 17:01:58.396426 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.396435 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.396664 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.396893 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.397851 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.399125 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.400993 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.401684 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.401944 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.405069 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.405076 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.405089 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.405115 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.406972 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.407656 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.407662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.407663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.407782 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.408212 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.408215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.408216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.408672 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.408858 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.409276 (+ 418us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.409475 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":560,"spinlock_wait_cycles":5504,"thread_start_us":208,"threads_started":1}
I20260806 17:01:58.413022 31710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:01:58.413945 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.413565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53358)
0806 17:01:58.413764 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.413867 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260806 17:01:58.414214 31659 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
I20260806 17:01:58.415207 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.414927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53368)
0806 17:01:58.415069 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.415115 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 17:01:58.415380 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:35251: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab.
Entry for principal kudu/127.7.153.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab.
I20260806 17:01:58.417474 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:35251
--webserver_interface=127.7.153.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab
--principal=kudu/127.7.153.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34903,127.7.153.61:35251,127.7.153.60:46367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:01:58.464672 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } attempt: 1
I20260806 17:01:58.465749 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.465413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53374)
0806 17:01:58.465588 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.465666 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 17:01:58.466532 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.466299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53386)
0806 17:01:58.466416 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.466472 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 17:01:58.466676 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:35251: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
I20260806 17:01:58.534866 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } attempt: 2
I20260806 17:01:58.535818 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.535472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53398)
0806 17:01:58.535672 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.535740 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 17:01:58.536572 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.536342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53408)
0806 17:01:58.536457 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.536512 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 17:01:58.536732 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:35251: Network error: Client connection negotiation failed: client connection to 127.7.153.61:35251: connect: Connection refused (error 111)
W20260806 17:01:58.543221 31717 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 17:01:58.543658 31717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:58.543725 31717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:58.543810 31717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:58.548628 31717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:58.548756 31717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:58.548802 31717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:58.548861 31717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:58.548900 31717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:58.555876 31717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34903,127.7.153.61:35251,127.7.153.60:46367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab
--principal=kudu/127.7.153.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:35251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.153.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:58.557325 31717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:58.558477 31717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:58.568710 31724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:58.568715 31726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:58.568688 31723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:58.569265 31717 server_base.cc:1034] running on GCE node
I20260806 17:01:58.569953 31717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:58.571331 31717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:58.572570 31717 hybrid_clock.cc:648] HybridClock initialized: now 1786035718572536 us; error 55 us; skew 500 ppm
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:58.575917 31717 init.cc:377] Logged in from keytab as kudu/127.7.153.61@KRBTEST.COM (short username kudu)
I20260806 17:01:58.577095 31717 webserver.cc:460] Webserver started at http://127.7.153.61:46185/ using document root <none> and password file <none>
I20260806 17:01:58.577718 31717 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:58.577787 31717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:58.577976 31717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:58.580302 31717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data/instance:
uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "1d95bfa4e89b62ca2e6b54ad026d498c"
server_key_iv: "c81b3921fdf11940d22c26b87c07543c"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.580991 31717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal/instance:
uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "1d95bfa4e89b62ca2e6b54ad026d498c"
server_key_iv: "c81b3921fdf11940d22c26b87c07543c"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.585472 31717 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 17:01:58.588549 31734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:58.590233 31717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 17:01:58.590430 31717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal
uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "1d95bfa4e89b62ca2e6b54ad026d498c"
server_key_iv: "c81b3921fdf11940d22c26b87c07543c"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.590580 31717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:58.603196 31717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:58.607806 31717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:58.608069 31717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:58.616008 31717 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.61:35251
I20260806 17:01:58.616397 31789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.61:35251 every 8 connection(s)
I20260806 17:01:58.617313 31717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
I20260806 17:01:58.620461 31790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:58.624817 31790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:01:58.626866 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31717
I20260806 17:01:58.627046 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-1/wal/instance
I20260806 17:01:58.627386 7780 external_mini_cluster.cc:1428] Setting key 37bf958ec2b148e004417e87284763a6
I20260806 17:01:58.627920 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } attempt: 3
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.60@KRBTEST.COM" created.
I20260806 17:01:58.642091 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.628438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53414)
0806 17:01:58.628771 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.628786 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.628872 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.630618 (+ 1746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.630622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.630832 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.630946 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.630953 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.633226 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.633230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.634120 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.634129 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.635041 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.635048 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.635208 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.635700 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.635723 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.637555 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.639940 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.639943 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.639948 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.640175 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.640539 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.640550 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.640552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.640663 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.641481 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.641484 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.641597 (+ 113us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.641716 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.641873 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":65}
I20260806 17:01:58.642486 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.627257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.7.153.62:34903)
0806 17:01:58.627417 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.627421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.628752 (+ 1331us) server_negotiation.cc:407] Connection header received
0806 17:01:58.630372 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.630376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.630433 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.630552 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.631859 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.632411 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.633740 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.634287 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.634448 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.637664 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.637668 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.637671 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.637697 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.639921 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.640555 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.640559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.640561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.640773 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.641182 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.641186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.641188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.641436 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.641555 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.642118 (+ 563us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.642275 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":58}
I20260806 17:01:58.643296 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.629034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53414 (local address 127.7.153.61:35251)
0806 17:01:58.629600 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.629617 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.629669 (+ 52us) server_negotiation.cc:407] Connection header received
0806 17:01:58.630112 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.630140 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.630410 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.631105 (+ 695us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.631542 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.633074 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.634261 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.634886 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.635019 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.637727 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.637736 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.637754 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.637788 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.639809 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.640296 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.640303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.640305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.640435 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.640799 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.640804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.640806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.641365 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.641522 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.641863 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.642226 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":439,"thread_start_us":192,"threads_started":1}
I20260806 17:01:58.643301 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.627869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34903 (local address 127.0.0.1:40542)
0806 17:01:58.628561 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.628632 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.630101 (+ 1469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.630636 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.630647 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.631174 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.631713 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.631725 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.632533 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.632538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.633602 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.633613 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.634464 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.634468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.634768 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.635562 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.635586 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.637482 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.640149 (+ 2667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.640156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.640167 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.640417 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.640895 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.640900 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.640902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.641001 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.641569 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.641579 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.641815 (+ 236us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.642669 (+ 854us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.642909 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":62,"thread_start_us":169,"threads_started":1}
I20260806 17:01:58.644948 31790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:01:58.646104 31710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:01:58.646888 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.646618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36736)
0806 17:01:58.646739 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.646799 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 17:01:58.647855 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.647546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36742)
0806 17:01:58.647729 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.647788 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260806 17:01:58.648105 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 17:01:58.655607 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.645576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53420)
0806 17:01:58.645681 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.645700 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.645794 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.646259 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.646265 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.646562 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.646729 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.646741 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.647788 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.647790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.648520 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.648535 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.649135 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.649138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.649230 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.649796 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.649815 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.651493 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.653404 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.653409 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.653411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.653626 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.654326 (+ 700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.654332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.654336 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.654455 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.654942 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.654945 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.655033 (+ 88us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.655152 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.655350 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 17:01:58.655611 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.645882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53420 (local address 127.7.153.61:35251)
0806 17:01:58.646004 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.646008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.646022 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:01:58.646068 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.646071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.646117 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.646207 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.646853 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.647666 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.648683 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.648998 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.649103 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.651663 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.651667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.651669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.651694 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.653255 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.653729 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.653735 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.653736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.654023 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.654592 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.654599 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.654602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.654835 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.654963 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.655209 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.655422 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":49}
I20260806 17:01:58.656639 31790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:01:58.657644 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.657334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36754)
0806 17:01:58.657468 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.657561 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 17:01:58.658301 31738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
I20260806 17:01:58.659438 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.659191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36768)
0806 17:01:58.659308 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.659369 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 17:01:58.659642 31790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab.
Entry for principal kudu/127.7.153.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab.
I20260806 17:01:58.663617 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:46367
--webserver_interface=127.7.153.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab
--principal=kudu/127.7.153.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:43599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:34903,127.7.153.61:35251,127.7.153.60:46367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:01:58.679311 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 1
I20260806 17:01:58.680374 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.680025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36778)
0806 17:01:58.680220 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.680289 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 17:01:58.681356 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.681105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36784)
0806 17:01:58.681242 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.681295 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 17:01:58.681591 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
I20260806 17:01:58.708995 31790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 1
I20260806 17:01:58.709982 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.709651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36788)
0806 17:01:58.709831 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.709900 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 17:01:58.710784 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.710562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36796)
0806 17:01:58.710671 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.710729 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 17:01:58.710920 31790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
I20260806 17:01:58.756775 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 2
I20260806 17:01:58.757833 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.757502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36808)
0806 17:01:58.757680 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.757746 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 17:01:58.758893 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.758631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36814)
0806 17:01:58.758782 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.758833 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 17:01:58.759259 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
I20260806 17:01:58.779126 31790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 2
I20260806 17:01:58.780146 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.779781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36824)
0806 17:01:58.779987 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.780051 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260806 17:01:58.781008 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.780779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36826)
0806 17:01:58.780889 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.780944 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 17:01:58.781143 31790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
W20260806 17:01:58.792276 31797 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 17:01:58.792753 31797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:01:58.792822 31797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:01:58.792900 31797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:01:58.797422 31797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:01:58.797533 31797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:01:58.797571 31797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:01:58.797631 31797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:01:58.797688 31797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:01:58.803694 31797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:43599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:34903,127.7.153.61:35251,127.7.153.60:46367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab
--principal=kudu/127.7.153.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:46367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.153.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:01:58.805059 31797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:01:58.806177 31797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:01:58.816047 31805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:58.816190 31803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:01:58.815991 31802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:01:58.816109 31797 server_base.cc:1034] running on GCE node
I20260806 17:01:58.817126 31797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:01:58.818423 31797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:01:58.819736 31797 hybrid_clock.cc:648] HybridClock initialized: now 1786035718819677 us; error 43 us; skew 500 ppm
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:01:58.824590 31797 init.cc:377] Logged in from keytab as kudu/127.7.153.60@KRBTEST.COM (short username kudu)
I20260806 17:01:58.825873 31797 webserver.cc:460] Webserver started at http://127.7.153.60:40585/ using document root <none> and password file <none>
I20260806 17:01:58.826493 31797 fs_manager.cc:359] Metadata directory not provided
I20260806 17:01:58.826565 31797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:01:58.826750 31797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:01:58.829161 31797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data/instance:
uuid: "11b86956dec043938e2cfb9e5f066fb3"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "be50818518e0565e1326130c9886f020"
server_key_iv: "b8a3e73e4ab60cc87e9bf3bbfae5daed"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.829733 31797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal/instance:
uuid: "11b86956dec043938e2cfb9e5f066fb3"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "be50818518e0565e1326130c9886f020"
server_key_iv: "b8a3e73e4ab60cc87e9bf3bbfae5daed"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.834151 31797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 17:01:58.836959 31812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:01:58.838410 31797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 17:01:58.838557 31797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal
uuid: "11b86956dec043938e2cfb9e5f066fb3"
format_stamp: "Formatted at 2026-08-06 17:01:58 on dist-test-slave-cbsf"
server_key: "be50818518e0565e1326130c9886f020"
server_key_iv: "b8a3e73e4ab60cc87e9bf3bbfae5daed"
server_key_version: "encryptionkey@0"
I20260806 17:01:58.838670 31797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:01:58.858613 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 3
I20260806 17:01:58.859689 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.859328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36836)
0806 17:01:58.859497 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.859566 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 17:01:58.860478 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.860249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36846)
0806 17:01:58.860368 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.860422 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 17:01:58.860625 31710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
I20260806 17:01:58.872350 31790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 3
I20260806 17:01:58.873451 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.873117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36852)
0806 17:01:58.873277 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.873356 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 17:01:58.874392 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.874076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36864)
0806 17:01:58.874230 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.874293 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260806 17:01:58.874596 31790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:46367: Network error: Client connection negotiation failed: client connection to 127.7.153.60:46367: connect: Connection refused (error 111)
I20260806 17:01:58.877206 31797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:01:58.881058 31797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:01:58.881239 31797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:01:58.888793 31797 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.60:46367
I20260806 17:01:58.889102 31870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.60:46367 every 8 connection(s)
I20260806 17:01:58.889957 31797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
I20260806 17:01:58.893213 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 31797
I20260806 17:01:58.893364 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786035416626244-7780-0/minicluster-data/master-2/wal/instance
I20260806 17:01:58.893568 31871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:01:58.893692 7780 external_mini_cluster.cc:1428] Setting key 947aabaf32ca7c74390c3926b2acda0a
I20260806 17:01:58.899370 31871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:58.912348 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.901558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.7.153.62:34903)
0806 17:01:58.901724 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.901729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.902138 (+ 409us) server_negotiation.cc:407] Connection header received
0806 17:01:58.902354 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.902357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.902413 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.902500 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.903297 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.903797 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.904983 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.905324 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.905483 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.908741 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.908749 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.908754 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.908796 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.910338 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.910897 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.910900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.910902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.911032 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.911387 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.911390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.911392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.911596 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.911708 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.912119 (+ 411us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.912230 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 17:01:58.912388 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.895233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36878 (local address 127.7.153.60:46367)
0806 17:01:58.895800 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.895818 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.895855 (+ 37us) server_negotiation.cc:407] Connection header received
0806 17:01:58.897030 (+ 1175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.897061 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.897524 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.897855 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.899027 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.901003 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.902265 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.902925 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.903123 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.906237 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.906248 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.906275 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.906316 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.908638 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.909233 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.909241 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.909257 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.909389 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.909724 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.909729 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.909731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.910243 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.910476 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.910835 (+ 359us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.911240 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":411,"thread_start_us":235,"threads_started":1}
I20260806 17:01:58.912410 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.901452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:34903 (local address 127.0.0.1:40558)
0806 17:01:58.901980 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.902039 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.902185 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.902603 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.902608 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.903005 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.903142 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.903149 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.903925 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.903929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.904579 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.904588 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.905535 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.905539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.905659 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.906262 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.906280 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.908423 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.910498 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.910509 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.910515 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.910780 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.911147 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.911151 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.911153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.911254 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.911715 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.911722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.911854 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.912019 (+ 165us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.912214 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"spinlock_wait_cycles":6400,"thread_start_us":226,"threads_started":1}
I20260806 17:01:58.913959 31871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:01:58.923575 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.914659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53430 (local address 127.7.153.61:35251)
0806 17:01:58.914796 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.914800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.914814 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:01:58.914913 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.914915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.914958 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.915065 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.915577 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.916149 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.917120 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.917418 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.917561 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.920239 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.920243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.920246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.920273 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.921839 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.922308 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.922311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.922313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.922399 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.922696 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.922701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.922703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.922906 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.923024 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.923295 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.923420 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 17:01:58.923575 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.914529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:35251 (local address 127.0.0.1:53430)
0806 17:01:58.914723 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.914739 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.914820 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.915079 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.915083 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.915285 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.915414 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.915421 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.916274 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.916281 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.916985 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.916995 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.917561 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.917565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.917665 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.918365 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.918382 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.920067 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.921972 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.921975 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.921977 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.922195 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.922505 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.922508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.922510 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.922599 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.923006 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.923009 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.923119 (+ 110us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.923225 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.923380 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117}
I20260806 17:01:58.924319 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.915232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40570 (local address 127.7.153.62:34903)
0806 17:01:58.915359 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.915362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.915376 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:01:58.915524 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.915526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.915565 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.915660 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.916331 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.916940 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.917776 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.918119 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.918232 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.921000 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.921003 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.921005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.921031 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.922526 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.922992 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.922995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.922997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.923087 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.923371 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.923375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.923377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.923570 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.923983 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.924079 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.924202 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 17:01:58.924926 31871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
Aug 06 17:01:58 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 17:01:58.934618 31876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.925516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36880)
0806 17:01:58.925668 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:58.925683 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:58.925771 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:58.926026 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:58.926028 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:58.926225 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:58.926344 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.926353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.927325 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.927328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.928108 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:58.928118 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.928812 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.928816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:58.928894 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.929403 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:58.929415 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:58.930895 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:58.932931 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.932935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.932937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.933177 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.933494 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:58.933497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:58.933499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:58.933611 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:58.934083 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:58.934088 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:58.934196 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 17:01:58.934309 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 17:01:58.934441 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 17:01:58.934821 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.925564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36880 (local address 127.7.153.60:46367)
0806 17:01:58.925670 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.925675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.925741 (+ 66us) server_negotiation.cc:407] Connection header received
0806 17:01:58.925865 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.925868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.925912 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.925995 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.926468 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.927195 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.928262 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.928608 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.928776 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.931049 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.931053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.931056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.931082 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.932821 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.933311 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.933314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.933315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.933394 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.933710 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.933715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.933716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.933964 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.934081 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.934427 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.934571 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 17:01:58.936034 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:58.925610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53438 (local address 127.7.153.61:35251)
0806 17:01:58.925716 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:58.925722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:58.925847 (+ 125us) server_negotiation.cc:407] Connection header received
0806 17:01:58.925941 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:58.925947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:58.925996 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:58.926075 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:58.926773 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.927468 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.928530 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:58.928897 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:58.928987 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:58.931784 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:58.931788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:58.931791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:58.931827 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:58.933507 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.934023 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.934026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.934046 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.934150 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:58.934599 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:58.934603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:58.934605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:58.934973 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:58.935260 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:58.935727 (+ 467us) server_negotiation.cc:299] Negotiation successful
0806 17:01:58.935843 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 17:01:58.939261 31871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: Bootstrap starting.
I20260806 17:01:58.940423 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:01:58.942257 31871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:58.943287 31871 log.cc:824] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:58.942498 31684 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40570
I20260806 17:01:58.945958 31871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: No bootstrap required, opened a new log
I20260806 17:01:58.950531 31871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:58.950816 31871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b86956dec043938e2cfb9e5f066fb3, State: Initialized, Role: FOLLOWER
I20260806 17:01:58.951231 31871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:58.951824 31878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:58.951996 31878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:01:58.952913 31871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 17:01:58.958837 31889 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:58.958971 31889 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:58.957469 31797 master_runner.cc:186] Error getting master registration for 127.7.153.62:34903: OK, instance_id { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" instance_seqno: 1786035718380103 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 17:01:58.961251 31797 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 17:01:59.017778 31790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 4
I20260806 17:01:59.024840 31710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } attempt: 4
Aug 06 17:01:59 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
I20260806 17:01:59.031144 31875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.018903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36890 (local address 127.7.153.60:46367)
0806 17:01:59.019043 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.019047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.019063 (+ 16us) server_negotiation.cc:407] Connection header received
0806 17:01:59.019156 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.019162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.019219 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.019309 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.019862 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.020738 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.021901 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.022221 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.022347 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.026655 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:59.026659 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:59.026662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:59.026704 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:59.029113 (+ 2409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.029733 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.029737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.029739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.029837 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.030146 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.030149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.030151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.030450 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:59.030557 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:59.030848 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 17:01:59.030984 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 17:01:59.031144 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.018537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36890)
0806 17:01:59.018735 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:59.018754 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:59.018873 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:59.019350 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:59.019353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:59.019602 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:59.019726 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:59.019733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.020891 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.020895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:59.021771 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:59.021782 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.022356 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.022360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:59.022446 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.023453 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:59.023482 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:59.026346 (+ 2864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:59.029264 (+ 2918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:59.029268 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:59.029270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:59.029629 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:59.029943 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:59.029946 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:59.029948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:59.030050 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:59.030563 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:59.030566 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:59.030678 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 17:01:59.030792 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 17:01:59.030948 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
Aug 06 17:01:59 dist-test-slave-cbsf krb5kdc[31624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035718, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
I20260806 17:01:59.035354 31790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: Bootstrap starting.
I20260806 17:01:59.038283 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.025619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:46367 (local address 127.0.0.1:36892)
0806 17:01:59.025816 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 17:01:59.025835 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 17:01:59.025970 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:01:59.028929 (+ 2959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:01:59.028935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:01:59.029156 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:01:59.029294 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:59.029302 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.030400 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.030404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:59.031203 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:01:59.031217 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.031806 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.031810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:01:59.031900 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.032436 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:01:59.032451 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:01:59.034168 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:01:59.036406 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:59.036410 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:59.036413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:59.036735 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:59.037063 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:01:59.037066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:01:59.037070 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:01:59.037193 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:01:59.037701 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:01:59.037705 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:01:59.037822 (+ 117us) client_negotiation.cc:769] Sending connection context
0806 17:01:59.037936 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 17:01:59.038105 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 17:01:59.038347 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.026111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36892 (local address 127.7.153.60:46367)
0806 17:01:59.027323 (+ 1212us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.027333 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.027351 (+ 18us) server_negotiation.cc:407] Connection header received
0806 17:01:59.027985 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.027994 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.028114 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.028885 (+ 771us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.029447 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.030287 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.031362 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.031669 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.031788 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.034332 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:59.034339 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:59.034343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:59.034373 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:59.036276 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.036837 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.036841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.036843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.036939 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.037306 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.037310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.037312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.037578 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:59.037686 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:59.038009 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 17:01:59.038143 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1071,"thread_start_us":308,"threads_started":1}
I20260806 17:01:59.038836 31790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:59.039861 31790 log.cc:824] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:59.042037 31790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: No bootstrap required, opened a new log
I20260806 17:01:59.042510 31710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23: Bootstrap starting.
I20260806 17:01:59.045547 31710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23: Neither blocks nor log segments found. Creating new log.
I20260806 17:01:59.045661 31790 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:59.045917 31790 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9900d1a4d94a92aa002f4ac8ef8baa, State: Initialized, Role: FOLLOWER
I20260806 17:01:59.046293 31790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:59.046532 31710 log.cc:824] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23: Log is configured to *not* fsync() on all Append() calls
I20260806 17:01:59.047927 31790 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:59.049302 31710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23: No bootstrap required, opened a new log
I20260806 17:01:59.050597 31893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.050736 31893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: This master's current role is: FOLLOWER
W20260806 17:01:59.054289 31905 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:59.054471 31905 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:59.051898 31717 master_runner.cc:186] Error getting master registration for 127.7.153.62:34903: OK, instance_id { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" instance_seqno: 1786035718380103 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 17:01:59.056137 31717 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 17:01:59.058446 31710 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:59.058763 31710 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8fbe0913f6f4b58b55918f8adbcfa23, State: Initialized, Role: FOLLOWER
I20260806 17:01:59.059151 31710 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:59.059846 31907 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.060185 31907 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:01:59.060869 31710 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:01:59.060918 31684 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 17:01:59.061055 31684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:59.062559 31684 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:59.063746 31684 leader_election.cc:288] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9900d1a4d94a92aa002f4ac8ef8baa (127.7.153.61:35251), 11b86956dec043938e2cfb9e5f066fb3 (127.7.153.60:46367)
I20260806 17:01:59.065565 31762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa"
I20260806 17:01:59.065889 31762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:59.067436 31762 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8fbe0913f6f4b58b55918f8adbcfa23 in term 1.
I20260806 17:01:59.068037 31842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "11b86956dec043938e2cfb9e5f066fb3"
I20260806 17:01:59.068341 31842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:01:59.069818 31842 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8fbe0913f6f4b58b55918f8adbcfa23 in term 1.
I20260806 17:01:59.071409 31659 leader_election.cc:302] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9900d1a4d94a92aa002f4ac8ef8baa, c8fbe0913f6f4b58b55918f8adbcfa23; no voters:
W20260806 17:01:59.077080 31918 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:01:59.077229 31918 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:01:59.077767 31637 master_runner.cc:263] No leader master found from master c8fbe0913f6f4b58b55918f8adbcfa23
I20260806 17:01:59.077837 31637 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 17:01:59.077994 31907 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:01:59.078311 31907 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [term 1 LEADER]: Becoming Leader. State: Replica: c8fbe0913f6f4b58b55918f8adbcfa23, State: Running, Role: LEADER
I20260806 17:01:59.078783 31907 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } }
I20260806 17:01:59.081233 31907 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8fbe0913f6f4b58b55918f8adbcfa23. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.081475 31907 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:59.087678 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.066327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40578 (local address 127.7.153.62:34903)
0806 17:01:59.066458 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.066463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.068443 (+ 1980us) server_negotiation.cc:407] Connection header received
0806 17:01:59.068791 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.068794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.068858 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.068913 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.072735 (+ 3822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.073508 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.078707 (+ 5199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.079064 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.079148 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.083708 (+ 4560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:59.083713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:59.083717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:59.083749 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:59.085636 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.086182 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.086186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.086188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.086279 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.086592 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.086596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.086598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.086844 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:59.086962 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:59.087332 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 17:01:59.087491 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 17:01:59.090669 31929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:01:59.091771 31929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:01:59.092720 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.067079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53440 (local address 127.7.153.61:35251)
0806 17:01:59.067198 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.067203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.070239 (+ 3036us) server_negotiation.cc:407] Connection header received
0806 17:01:59.070413 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.070416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.070471 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.070525 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.074687 (+ 4162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.075381 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.079967 (+ 4586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.080338 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.080423 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.084600 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:59.084605 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:59.084608 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:59.084643 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:59.086445 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.090145 (+ 3700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.090151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.090153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.090276 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.091019 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.091023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.091025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.091280 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:59.091419 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:59.092349 (+ 930us) server_negotiation.cc:299] Negotiation successful
0806 17:01:59.092504 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 17:01:59.095903 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:01:59.067742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36908 (local address 127.7.153.60:46367)
0806 17:01:59.067856 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.067861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.070104 (+ 2243us) server_negotiation.cc:407] Connection header received
0806 17:01:59.071629 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.071633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.071687 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.071739 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.076582 (+ 4843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.077375 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.081143 (+ 3768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:01:59.081518 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:01:59.081612 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:01:59.087037 (+ 5425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:01:59.087042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:01:59.087046 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:01:59.087084 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:01:59.088836 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.091803 (+ 2967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.091807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.091809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.091940 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:01:59.094481 (+ 2541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:01:59.094488 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:01:59.094490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:01:59.094814 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:01:59.094980 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 17:01:59.095544 (+ 564us) server_negotiation.cc:299] Negotiation successful
0806 17:01:59.095720 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 17:01:59.105620 31842 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [term 1 FOLLOWER]: Refusing update from remote peer c8fbe0913f6f4b58b55918f8adbcfa23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:59.105620 31762 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [term 1 FOLLOWER]: Refusing update from remote peer c8fbe0913f6f4b58b55918f8adbcfa23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:01:59.106575 31907 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:01:59.107110 31907 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 17:01:59.109961 31740 tablet.cc:2369] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 17:01:59.117134 31878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8fbe0913f6f4b58b55918f8adbcfa23. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.117321 31878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:01:59.119029 31893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8fbe0913f6f4b58b55918f8adbcfa23. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.119199 31893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:01:59.126258 31927 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.126426 31927 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:59.126552 31930 mvcc.cc:205] Tried to move back new op lower bound from 7315602305447698432 to 7315602305351385088. Current Snapshot: MvccSnapshot[applied={T|T < 7315602305447698432}]
I20260806 17:01:59.129640 31878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.129799 31878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:01:59.130303 31933 mvcc.cc:205] Tried to move back new op lower bound from 7315602305447698432 to 7315602305351385088. Current Snapshot: MvccSnapshot[applied={T|T < 7315602305447698432}]
I20260806 17:01:59.137043 31907 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.137244 31907 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23 [sys.catalog]: This master's current role is: LEADER
I20260806 17:01:59.138792 31893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8fbe0913f6f4b58b55918f8adbcfa23" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 34903 } } peers { permanent_uuid: "5e9900d1a4d94a92aa002f4ac8ef8baa" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 35251 } } peers { permanent_uuid: "11b86956dec043938e2cfb9e5f066fb3" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 46367 } } }
I20260806 17:01:59.138988 31893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:01:59.140148 31929 catalog_manager.cc:1347] Generated new cluster ID: c9f55b04effb4c54a360ab7d66f422ff
I20260806 17:01:59.140228 31929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:01:59.175658 31929 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:01:59.177197 31929 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:01:59.194058 31929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8fbe0913f6f4b58b55918f8adbcfa23: Generated new TSK 0
I20260806 17:01:59.195106 31929 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 17:01:59.236969 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.234874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40582 (local address 127.7.153.62:34903)
0806 17:01:59.235039 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.235045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.235643 (+ 598us) server_negotiation.cc:407] Connection header received
0806 17:01:59.235875 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.235879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.235938 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.236001 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.236818 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40582: BlockingRecv error: recv got EOF from 127.0.0.1:40582 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 17:01:59.237692 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.235339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53444 (local address 127.7.153.61:35251)
0806 17:01:59.235498 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.235503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.236623 (+ 1120us) server_negotiation.cc:407] Connection header received
0806 17:01:59.236864 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.236868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.236933 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.236988 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.237572 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53444: BlockingRecv error: recv got EOF from 127.0.0.1:53444 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260806 17:01:59.238703 31891 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.236079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.7.153.60:46367)
0806 17:01:59.236199 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.236204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.237562 (+ 1358us) server_negotiation.cc:407] Connection header received
0806 17:01:59.237756 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.237760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.237823 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.237875 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.238579 (+ 704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36918: BlockingRecv error: recv got EOF from 127.0.0.1:36918 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 17:01:59.242435 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.240929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.7.153.61:35251)
0806 17:01:59.241060 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.241066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.241282 (+ 216us) server_negotiation.cc:407] Connection header received
0806 17:01:59.241469 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.241474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.241564 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.241661 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.242310 (+ 649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53458: BlockingRecv error: recv got EOF from 127.0.0.1:53458 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 17:01:59.254179 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.245902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53472 (local address 127.7.153.61:35251)
0806 17:01:59.246078 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.246082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.253023 (+ 6941us) server_negotiation.cc:407] Connection header received
0806 17:01:59.253201 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.253206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.253290 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.253409 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.254038 (+ 629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53472: BlockingRecv error: recv got EOF from 127.0.0.1:53472 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 17:01:59.260262 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.258729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53474 (local address 127.7.153.61:35251)
0806 17:01:59.258886 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.258891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.259235 (+ 344us) server_negotiation.cc:407] Connection header received
0806 17:01:59.259370 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.259373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.259437 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.259532 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.260124 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53474: BlockingRecv error: recv got EOF from 127.0.0.1:53474 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 17:01:59.267845 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.266386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.7.153.61:35251)
0806 17:01:59.266529 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.266534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.266815 (+ 281us) server_negotiation.cc:407] Connection header received
0806 17:01:59.266958 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.266961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.267033 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.267145 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.267716 (+ 571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53484: BlockingRecv error: recv got EOF from 127.0.0.1:53484 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 17:01:59.279328 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.278054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.7.153.61:35251)
0806 17:01:59.278234 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.278239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.278365 (+ 126us) server_negotiation.cc:407] Connection header received
0806 17:01:59.278548 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.278554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.278616 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.278712 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.279195 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53496: BlockingRecv error: recv got EOF from 127.0.0.1:53496 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 17:01:59.299019 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.297816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53506 (local address 127.7.153.61:35251)
0806 17:01:59.297971 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.297976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.298148 (+ 172us) server_negotiation.cc:407] Connection header received
0806 17:01:59.298258 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.298261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.298319 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.298419 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.298891 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53506: BlockingRecv error: recv got EOF from 127.0.0.1:53506 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 17:01:59.334324 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.333258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.7.153.61:35251)
0806 17:01:59.333395 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.333398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.333525 (+ 127us) server_negotiation.cc:407] Connection header received
0806 17:01:59.333659 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.333662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.333714 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.333801 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.334220 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53508: BlockingRecv error: recv got EOF from 127.0.0.1:53508 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 17:01:59.401882 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.400679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53520 (local address 127.7.153.61:35251)
0806 17:01:59.400864 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.400870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.401021 (+ 151us) server_negotiation.cc:407] Connection header received
0806 17:01:59.401159 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.401162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.401229 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.401344 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.401772 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53520: BlockingRecv error: recv got EOF from 127.0.0.1:53520 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 17:01:59.533957 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.532312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.7.153.61:35251)
0806 17:01:59.532478 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.532482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.532532 (+ 50us) server_negotiation.cc:407] Connection header received
0806 17:01:59.532898 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.532903 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.532990 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.533114 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.533784 (+ 670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53534: BlockingRecv error: recv got EOF from 127.0.0.1:53534 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260806 17:01:59.793776 31793 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:01:59.792560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53536 (local address 127.7.153.61:35251)
0806 17:01:59.792772 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 17:01:59.792777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:01:59.792795 (+ 18us) server_negotiation.cc:407] Connection header received
0806 17:01:59.792980 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:01:59.792984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:01:59.793047 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:01:59.793157 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:01:59.793642 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53536: BlockingRecv error: recv got EOF from 127.0.0.1:53536 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 17:01:59.960476 31889 catalog_manager.cc:1259] Loaded cluster ID: c9f55b04effb4c54a360ab7d66f422ff
I20260806 17:01:59.960577 31889 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: loading cluster ID for follower catalog manager: success
I20260806 17:01:59.962620 31889 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: acquiring CA information for follower catalog manager: success
I20260806 17:01:59.963976 31889 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 11b86956dec043938e2cfb9e5f066fb3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 17:02:00.056007 31905 catalog_manager.cc:1259] Loaded cluster ID: c9f55b04effb4c54a360ab7d66f422ff
I20260806 17:02:00.056138 31905 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: loading cluster ID for follower catalog manager: success
I20260806 17:02:00.058014 31905 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: acquiring CA information for follower catalog manager: success
I20260806 17:02:00.059320 31905 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5e9900d1a4d94a92aa002f4ac8ef8baa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 17:02:00.312387 32010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:00.308259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.7.153.61:35251)
0806 17:02:00.308535 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:00.308539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:00.308554 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:02:00.308606 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:00.308608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:00.308764 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:00.308872 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:00.309218 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.309776 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.310776 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.311008 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.311099 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:00.311433 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:00.311928 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:00.312045 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:00.312171 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 17:02:00.312229 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":106,"threads_started":1}
I20260806 17:02:00.319866 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:00.315946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56824 (local address 127.7.153.60:46367)
0806 17:02:00.316187 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:00.316191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:00.316205 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:02:00.316373 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:00.316375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:00.316504 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:00.316614 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:00.316957 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.317506 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.318360 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.318587 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.318736 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:00.319029 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:00.319504 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:00.319603 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:00.319678 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 17:02:00.319734 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":91,"threads_started":1}
I20260806 17:02:00.327747 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:00.323929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56840 (local address 127.7.153.60:46367)
0806 17:02:00.324046 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:00.324050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:00.324183 (+ 133us) server_negotiation.cc:407] Connection header received
0806 17:02:00.324345 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:00.324349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:00.324426 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:00.324505 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:00.324782 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.325492 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.326349 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.326623 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.326724 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:00.327001 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:00.327096 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:00.327175 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:00.327524 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 17:02:00.327582 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 17:02:00.327984 32010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:00.323529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51700 (local address 127.7.153.61:35251)
0806 17:02:00.323668 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:00.323674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:00.323772 (+ 98us) server_negotiation.cc:407] Connection header received
0806 17:02:00.323952 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:00.323955 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:00.324022 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:00.324070 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:00.324436 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.325293 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.326566 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.326894 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.327015 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:00.327320 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:00.327398 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:00.327469 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:00.327793 (+ 324us) server_negotiation.cc:299] Negotiation successful
0806 17:02:00.327861 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 17:02:00.328990 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:00.323183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.7.153.62:34903)
0806 17:02:00.323447 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:00.323452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:00.323468 (+ 16us) server_negotiation.cc:407] Connection header received
0806 17:02:00.323728 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:00.323734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:00.323936 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:00.324055 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:00.324498 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.325165 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.327093 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:00.327448 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:00.327552 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:00.327861 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:00.328403 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:00.328512 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:00.328686 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 17:02:00.328823 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":71,"threads_started":1}
I20260806 17:02:00.332978 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31637
I20260806 17:02:00.342530 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31717
I20260806 17:02:00.351164 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 31797
2026-08-06T17:02:00Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3446 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 17:02:00 dist-test-slave-cbsf krb5kdc[32031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 17:02:00 dist-test-slave-cbsf krb5kdc[32031](info): set up 2 sockets
Aug 06 17:02:00 dist-test-slave-cbsf krb5kdc[32031](info): commencing operation
krb5kdc: starting...
W20260806 17:02:01.456959 7780 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/test-user.keytab.
Aug 06 17:02:01 dist-test-slave-cbsf krb5kdc[32031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T17:02:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T17:02:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.153.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
Entry for principal kudu/127.7.153.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab.
I20260806 17:02:01.599783 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:39259
--webserver_interface=127.7.153.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:39259,127.7.153.61:46359,127.7.153.60:38359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 17:02:01.723167 32044 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 17:02:01.723492 32044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:02:01.723524 32044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:02:01.723637 32044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:02:01.728011 32044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:02:01.728091 32044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:02:01.728111 32044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:02:01.728128 32044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:02:01.728145 32044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:02:01.734104 32044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:39259,127.7.153.61:46359,127.7.153.60:38359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.62.keytab
--principal=kudu/127.7.153.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.62:39259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.153.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:02:01.735364 32044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:02:01.736510 32044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:02:01.746166 32049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:02:01.746166 32052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:02:01.746217 32044 server_base.cc:1034] running on GCE node
W20260806 17:02:01.746166 32050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:02:01.747150 32044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:02:01.748445 32044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:02:01.749684 32044 hybrid_clock.cc:648] HybridClock initialized: now 1786035721749662 us; error 35 us; skew 500 ppm
Aug 06 17:02:01 dist-test-slave-cbsf krb5kdc[32031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:02:01.752954 32044 init.cc:377] Logged in from keytab as kudu/127.7.153.62@KRBTEST.COM (short username kudu)
I20260806 17:02:01.754079 32044 webserver.cc:460] Webserver started at http://127.7.153.62:34145/ using document root <none> and password file <none>
I20260806 17:02:01.754727 32044 fs_manager.cc:359] Metadata directory not provided
I20260806 17:02:01.754827 32044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:02:01.755087 32044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:02:01.757596 32044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data/instance:
uuid: "802be78db6794c378d0316a06ed64695"
format_stamp: "Formatted at 2026-08-06 17:02:01 on dist-test-slave-cbsf"
server_key: "eae60b9a493e736e708352fbe476dcdc"
server_key_iv: "ad39f08daf028231c9f99bb6656e38d1"
server_key_version: "encryptionkey@0"
I20260806 17:02:01.758210 32044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal/instance:
uuid: "802be78db6794c378d0316a06ed64695"
format_stamp: "Formatted at 2026-08-06 17:02:01 on dist-test-slave-cbsf"
server_key: "eae60b9a493e736e708352fbe476dcdc"
server_key_iv: "ad39f08daf028231c9f99bb6656e38d1"
server_key_version: "encryptionkey@0"
I20260806 17:02:01.762742 32044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 17:02:01.765743 32059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:02:01.767449 32044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 17:02:01.767634 32044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal
uuid: "802be78db6794c378d0316a06ed64695"
format_stamp: "Formatted at 2026-08-06 17:02:01 on dist-test-slave-cbsf"
server_key: "eae60b9a493e736e708352fbe476dcdc"
server_key_iv: "ad39f08daf028231c9f99bb6656e38d1"
server_key_version: "encryptionkey@0"
I20260806 17:02:01.767771 32044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:02:01.784781 32044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:02:01.788461 32044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:02:01.788695 32044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:02:01.796510 32044 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.62:39259
I20260806 17:02:01.796849 32114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.62:39259 every 8 connection(s)
I20260806 17:02:01.797724 32044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/data/info.pb
I20260806 17:02:01.798156 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 32044
I20260806 17:02:01.798313 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-0/wal/instance
I20260806 17:02:01.798645 7780 external_mini_cluster.cc:1428] Setting key c0cc21b0631459445aa978d1ce5cf6f6
I20260806 17:02:01.801142 32115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:02:01.805696 32115 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.153.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.61@KRBTEST.COM" created.
Aug 06 17:02:01 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:02:01.824432 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.808276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:39259 (local address 127.0.0.1:48024)
0806 17:02:01.808906 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.808949 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:01.810013 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:01.810948 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:01.810956 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:01.811507 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:01.811926 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:01.811950 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:01.813354 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:01.813359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:01.814669 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:01.814686 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:01.815453 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:01.815461 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:01.815657 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:01.816388 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:01.816413 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:01.818488 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:01.821175 (+ 2687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:01.821184 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:01.821197 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:01.821471 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:01.821820 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:01.821822 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:01.821824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:01.821945 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:01.822815 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:01.822821 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:01.822956 (+ 135us) client_negotiation.cc:769] Sending connection context
0806 17:02:01.823129 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 17:02:01.823542 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":3,"thread_start_us":167,"threads_started":1}
I20260806 17:02:01.824433 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.808269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48024 (local address 127.7.153.62:39259)
0806 17:02:01.808882 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:01.808903 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:01.809075 (+ 172us) server_negotiation.cc:407] Connection header received
0806 17:02:01.810432 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:01.810442 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:01.810714 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:01.810883 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:01.812139 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:01.813204 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:01.814832 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:01.815253 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:01.815390 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:01.818698 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:01.818706 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:01.818726 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:01.818759 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:01.821027 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:01.821599 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:01.821604 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:01.821605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:01.821722 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:01.822112 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:01.822115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:01.822116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:01.822652 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:01.822817 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:01.823258 (+ 441us) server_negotiation.cc:299] Negotiation successful
0806 17:02:01.823650 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":117,"server-negotiator.queue_time_us":478,"spinlock_wait_cycles":68992,"thread_start_us":222,"threads_started":1}
I20260806 17:02:01.827320 32115 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:01.828183 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.827903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46798)
0806 17:02:01.828032 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.828111 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 17:02:01.828439 32061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
I20260806 17:02:01.829564 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.829301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46802)
0806 17:02:01.829434 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.829494 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 17:02:01.829764 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:46359: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab.
Entry for principal kudu/127.7.153.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab.
I20260806 17:02:01.831282 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:46359
--webserver_interface=127.7.153.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab
--principal=kudu/127.7.153.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:39259,127.7.153.61:46359,127.7.153.60:38359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:02:01.879051 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } attempt: 1
I20260806 17:02:01.880115 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.879728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46816)
0806 17:02:01.879940 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.880013 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260806 17:02:01.881142 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.880901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46828)
0806 17:02:01.881012 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.881076 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 17:02:01.881287 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:46359: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
I20260806 17:02:01.949465 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } attempt: 2
I20260806 17:02:01.950448 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.950108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46832)
0806 17:02:01.950296 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.950363 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 17:02:01.951357 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:01.951094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46846)
0806 17:02:01.951228 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:01.951293 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 17:02:01.951505 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.61:46359: Network error: Client connection negotiation failed: client connection to 127.7.153.61:46359: connect: Connection refused (error 111)
W20260806 17:02:01.954506 32122 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 17:02:01.954896 32122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:02:01.954958 32122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:02:01.955040 32122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:02:01.959546 32122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:02:01.959651 32122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:02:01.959690 32122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:02:01.959748 32122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:02:01.959785 32122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:02:01.965894 32122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:39259,127.7.153.61:46359,127.7.153.60:38359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.61.keytab
--principal=kudu/127.7.153.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.61:46359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.153.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:02:01.967203 32122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:02:01.968319 32122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:02:01.977797 32127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:02:01.977752 32128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:02:01.977833 32131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:02:01.978228 32122 server_base.cc:1034] running on GCE node
I20260806 17:02:01.978929 32122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:02:01.980237 32122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:02:01.981447 32122 hybrid_clock.cc:648] HybridClock initialized: now 1786035721981431 us; error 37 us; skew 500 ppm
Aug 06 17:02:01 dist-test-slave-cbsf krb5kdc[32031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:02:01.985877 32122 init.cc:377] Logged in from keytab as kudu/127.7.153.61@KRBTEST.COM (short username kudu)
I20260806 17:02:01.987030 32122 webserver.cc:460] Webserver started at http://127.7.153.61:35633/ using document root <none> and password file <none>
I20260806 17:02:01.987685 32122 fs_manager.cc:359] Metadata directory not provided
I20260806 17:02:01.987787 32122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:02:01.988046 32122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:02:01.990450 32122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data/instance:
uuid: "78e44838e8cd45b8bf0c2b202e9270b9"
format_stamp: "Formatted at 2026-08-06 17:02:01 on dist-test-slave-cbsf"
server_key: "49dc43272976919b54386fab162e79ce"
server_key_iv: "2b552c87cd2c72a255bd47263c3dca24"
server_key_version: "encryptionkey@0"
I20260806 17:02:01.991082 32122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal/instance:
uuid: "78e44838e8cd45b8bf0c2b202e9270b9"
format_stamp: "Formatted at 2026-08-06 17:02:01 on dist-test-slave-cbsf"
server_key: "49dc43272976919b54386fab162e79ce"
server_key_iv: "2b552c87cd2c72a255bd47263c3dca24"
server_key_version: "encryptionkey@0"
I20260806 17:02:01.995448 32122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 17:02:01.998440 32140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:02:02.000025 32122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 17:02:02.000203 32122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal
uuid: "78e44838e8cd45b8bf0c2b202e9270b9"
format_stamp: "Formatted at 2026-08-06 17:02:01 on dist-test-slave-cbsf"
server_key: "49dc43272976919b54386fab162e79ce"
server_key_iv: "2b552c87cd2c72a255bd47263c3dca24"
server_key_version: "encryptionkey@0"
I20260806 17:02:02.000344 32122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:02:02.016371 32122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:02:02.019824 32122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:02:02.020064 32122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:02:02.028445 32122 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.61:46359
I20260806 17:02:02.028848 32195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.61:46359 every 8 connection(s)
I20260806 17:02:02.029654 32122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/data/info.pb
I20260806 17:02:02.032954 32196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:02:02.037248 32196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:02.039901 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 32122
I20260806 17:02:02.040009 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-1/wal/instance
I20260806 17:02:02.040354 7780 external_mini_cluster.cc:1428] Setting key 63f6690d035cbbb17e1245813c0453e4
I20260806 17:02:02.042685 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } attempt: 3
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.153.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.153.60@KRBTEST.COM" created.
I20260806 17:02:02.054421 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.039380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48030 (local address 127.7.153.62:39259)
0806 17:02:02.039590 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.039595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.040636 (+ 1041us) server_negotiation.cc:407] Connection header received
0806 17:02:02.041729 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.041735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.041812 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.041926 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.043381 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.044021 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.045682 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.045932 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.046067 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.049664 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.049668 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.049670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.049702 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.051839 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.052463 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.052466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.052468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.052566 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.053007 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.053011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.053012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.053306 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.053408 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.054076 (+ 668us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.054224 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 17:02:02.055410 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.039817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:39259 (local address 127.0.0.1:48030)
0806 17:02:02.040436 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.040493 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.041486 (+ 993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.042105 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.042112 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.042512 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.043190 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.043211 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.044166 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.044169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.045559 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.045569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.046225 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.046228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.046390 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.047054 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.047084 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.049455 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.051979 (+ 2524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.051988 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.052001 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.052342 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.052664 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.052668 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.052670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.052883 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.053410 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.053419 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.053731 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.054063 (+ 332us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.054426 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":233,"threads_started":1}
I20260806 17:02:02.056890 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.043197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46856)
0806 17:02:02.043408 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.043426 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.043509 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.044311 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.044314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.044531 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.045156 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.045167 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.046739 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.046743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.047344 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.047353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.048010 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.048014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.048130 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.048632 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.048644 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.050064 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.052866 (+ 2802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.052871 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.052873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.053070 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.053486 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.053489 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.053491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.053573 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.054172 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.054178 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.054302 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.056505 (+ 2203us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.056733 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260806 17:02:02.057269 32196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:02.057610 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.043261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46856 (local address 127.7.153.61:46359)
0806 17:02:02.043797 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.043810 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.043835 (+ 25us) server_negotiation.cc:407] Connection header received
0806 17:02:02.043885 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.043893 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.044112 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.044300 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.045306 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.046627 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.047485 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.047868 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.047983 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.050256 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.050266 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.050285 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.050312 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.052747 (+ 2435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.053225 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.053231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.053233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.053329 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.053669 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.053674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.053675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.054038 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.057116 (+ 3078us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.057263 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.057433 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":123,"threads_started":1}
I20260806 17:02:02.059999 32115 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:02.060824 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.060526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59960)
0806 17:02:02.060648 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.060734 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 17:02:02.061633 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.061380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59964)
0806 17:02:02.061522 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.061570 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260806 17:02:02.061821 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 17:02:02.067816 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.058040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46858 (local address 127.7.153.61:46359)
0806 17:02:02.058180 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.058185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.058199 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:02:02.058241 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.058243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.058281 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.058347 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.058862 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.059637 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.061158 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.061608 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.061736 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.064162 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.064165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.064167 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.064189 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.065781 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.066412 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.066418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.066423 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.066516 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.066784 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.066787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.066788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.067081 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.067169 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.067519 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.067678 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":29}
I20260806 17:02:02.068132 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.057857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46858)
0806 17:02:02.057988 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.058002 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.058087 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.058388 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.058391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.058580 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.058705 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.058712 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.059997 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.060001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.061012 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.061026 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.061821 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.061825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.061989 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.062535 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.062547 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.063993 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.065933 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.065936 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.065938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.066148 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.066610 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.066613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.066614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.066700 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.067213 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.067216 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.067320 (+ 104us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.067476 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.067786 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":100}
I20260806 17:02:02.068994 32196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:02.069859 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.069569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59966)
0806 17:02:02.069692 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.069797 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 17:02:02.070096 32141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
I20260806 17:02:02.071048 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.070831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59972)
0806 17:02:02.070942 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.070994 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 17:02:02.071247 32196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.153.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab.
Entry for principal kudu/127.7.153.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab.
I20260806 17:02:02.074874 7780 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
/tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:38359
--webserver_interface=127.7.153.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab
--principal=kudu/127.7.153.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.153.20:46823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.153.62:39259,127.7.153.61:46359,127.7.153.60:38359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 17:02:02.093003 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 1
I20260806 17:02:02.093945 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.093638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59974)
0806 17:02:02.093789 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.093861 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 17:02:02.094688 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.094452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59982)
0806 17:02:02.094576 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.094629 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 17:02:02.094826 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
I20260806 17:02:02.120591 32196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 1
I20260806 17:02:02.121695 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.121291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:59998)
0806 17:02:02.121484 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.121559 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 17:02:02.122628 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.122382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60006)
0806 17:02:02.122507 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.122563 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 17:02:02.122826 32196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
I20260806 17:02:02.170068 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 2
I20260806 17:02:02.171345 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.170968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60012)
0806 17:02:02.171136 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.171212 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 17:02:02.172242 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.171984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60020)
0806 17:02:02.172105 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.172164 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 17:02:02.172390 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
I20260806 17:02:02.191052 32196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 2
I20260806 17:02:02.192028 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.191699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60036)
0806 17:02:02.191874 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.191940 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 17:02:02.192893 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.192599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60044)
0806 17:02:02.192741 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.192794 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 17:02:02.193042 32196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
W20260806 17:02:02.200863 32203 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 17:02:02.201274 32203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 17:02:02.201337 32203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 17:02:02.201433 32203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 17:02:02.205714 32203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 17:02:02.205811 32203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 17:02:02.205849 32203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 17:02:02.205901 32203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 17:02:02.205938 32203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 17:02:02.211736 32203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.153.20:46823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.153.62:39259,127.7.153.61:46359,127.7.153.60:38359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/krb5kdc/kudu_127.7.153.60.keytab
--principal=kudu/127.7.153.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.153.60:38359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.153.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 16:21:21 UTC on ccycloud.quasar-yoghow.root.comops.site
build id 4570853
I20260806 17:02:02.213122 32203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 17:02:02.214252 32203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 17:02:02.223686 32211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:02:02.223865 32203 server_base.cc:1034] running on GCE node
W20260806 17:02:02.223688 32208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 17:02:02.223688 32209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 17:02:02.224740 32203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 17:02:02.226023 32203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 17:02:02.227216 32203 hybrid_clock.cc:648] HybridClock initialized: now 1786035722227186 us; error 46 us; skew 500 ppm
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035722, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 17:02:02.230312 32203 init.cc:377] Logged in from keytab as kudu/127.7.153.60@KRBTEST.COM (short username kudu)
I20260806 17:02:02.231411 32203 webserver.cc:460] Webserver started at http://127.7.153.60:35929/ using document root <none> and password file <none>
I20260806 17:02:02.232038 32203 fs_manager.cc:359] Metadata directory not provided
I20260806 17:02:02.232105 32203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 17:02:02.232347 32203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 17:02:02.234786 32203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data/instance:
uuid: "d3abbfcd511e433b85531f153a92038d"
format_stamp: "Formatted at 2026-08-06 17:02:02 on dist-test-slave-cbsf"
server_key: "481fa1cc32d370a2eebe28c7436d05dc"
server_key_iv: "89bdf0db7861e6c70d8aa61ff9870ce2"
server_key_version: "encryptionkey@0"
I20260806 17:02:02.235414 32203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal/instance:
uuid: "d3abbfcd511e433b85531f153a92038d"
format_stamp: "Formatted at 2026-08-06 17:02:02 on dist-test-slave-cbsf"
server_key: "481fa1cc32d370a2eebe28c7436d05dc"
server_key_iv: "89bdf0db7861e6c70d8aa61ff9870ce2"
server_key_version: "encryptionkey@0"
I20260806 17:02:02.239735 32203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 17:02:02.242545 32218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 17:02:02.243959 32203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 17:02:02.244148 32203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data,/tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal
uuid: "d3abbfcd511e433b85531f153a92038d"
format_stamp: "Formatted at 2026-08-06 17:02:02 on dist-test-slave-cbsf"
server_key: "481fa1cc32d370a2eebe28c7436d05dc"
server_key_iv: "89bdf0db7861e6c70d8aa61ff9870ce2"
server_key_version: "encryptionkey@0"
I20260806 17:02:02.244287 32203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 17:02:02.261798 32203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 17:02:02.265743 32203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 17:02:02.265973 32203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 17:02:02.271593 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 3
I20260806 17:02:02.272469 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.272129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60050)
0806 17:02:02.272275 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.272361 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 17:02:02.273337 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.273106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60052)
0806 17:02:02.273221 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.273271 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 17:02:02.273535 32115 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.153.60:38359: Network error: Client connection negotiation failed: client connection to 127.7.153.60:38359: connect: Connection refused (error 111)
I20260806 17:02:02.274308 32203 rpc_server.cc:307] RPC server started. Bound to: 127.7.153.60:38359
I20260806 17:02:02.274610 32276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.153.60:38359 every 8 connection(s)
I20260806 17:02:02.275461 32203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/data/info.pb
I20260806 17:02:02.278648 32277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 17:02:02.282891 32277 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:02.284220 32196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 3
I20260806 17:02:02.285190 7780 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu as pid 32203
I20260806 17:02:02.285328 7780 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ6ny6/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786035416626244-7780-0/minicluster-data/master-2/wal/instance
I20260806 17:02:02.285653 7780 external_mini_cluster.cc:1428] Setting key 62358be618f95a88c49402ed69472ff6
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.61@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035722, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
I20260806 17:02:02.299435 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.285131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48036 (local address 127.7.153.62:39259)
0806 17:02:02.285281 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.285285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.286476 (+ 1191us) server_negotiation.cc:407] Connection header received
0806 17:02:02.287689 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.287692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.287761 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.287856 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.289072 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.289588 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.290808 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.291035 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.291163 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.295221 (+ 4058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.295233 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.295236 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.295277 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.297115 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.297663 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.297668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.297669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.297780 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.298168 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.298174 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.298179 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.298475 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.298597 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.299132 (+ 535us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.299294 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 17:02:02.299629 32198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.285086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60068)
0806 17:02:02.285406 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.285424 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.285542 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.288064 (+ 2522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.288067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.288286 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.288402 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.288410 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.290355 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.290359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.291112 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.291126 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.291956 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.291960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.292046 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.292460 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.292471 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.294205 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.296902 (+ 2697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.296908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.296911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.297227 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.297968 (+ 741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.297971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.297973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.298078 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.299011 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.299014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.299135 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.299254 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.299426 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235}
I20260806 17:02:02.301487 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.285648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.62:39259 (local address 127.0.0.1:48036)
0806 17:02:02.286305 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.286370 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.287469 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.287914 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.287923 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.288454 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.288897 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.288916 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.289703 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.289708 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.290677 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.290688 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.291207 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.291212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.291402 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.292362 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.292388 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.295068 (+ 2680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.297243 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.297255 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.297268 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.297534 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.297877 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.297881 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.297883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.298049 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.298586 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.298593 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.298841 (+ 248us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.300015 (+ 1174us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.300498 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":119,"spinlock_wait_cycles":101632,"thread_start_us":154,"threads_started":1}
I20260806 17:02:02.301491 32281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.286317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.7.153.60:38359)
0806 17:02:02.286752 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.286767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.286934 (+ 167us) server_negotiation.cc:407] Connection header received
0806 17:02:02.287488 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.287521 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.287846 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.288046 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.288928 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.290197 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.292032 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.292269 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.292380 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.295735 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.295742 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.295746 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.295777 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.298285 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.298836 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.298840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.298841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.298919 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.299251 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.299254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.299256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.299463 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.299648 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.300365 (+ 717us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.300577 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":130,"server-negotiator.queue_time_us":335,"spinlock_wait_cycles":2688,"thread_start_us":156,"threads_started":1}
I20260806 17:02:02.301491 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.286685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60068 (local address 127.7.153.60:38359)
0806 17:02:02.286980 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.286988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.287001 (+ 13us) server_negotiation.cc:407] Connection header received
0806 17:02:02.287488 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.287539 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.287846 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.288540 (+ 694us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.288626 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.290197 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.291254 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.291791 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.291941 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.294379 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.294388 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.294407 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.294441 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.296759 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.297688 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.297699 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.297702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.297855 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.298190 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.298193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.298195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.298894 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.299052 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.300065 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.300376 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":332,"server-negotiator.queue_time_us":220,"spinlock_wait_cycles":17408,"thread_start_us":78,"threads_started":1}
I20260806 17:02:02.303594 32277 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } has no permanent_uuid. Determining permanent_uuid...
I20260806 17:02:02.306169 32196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: Bootstrap starting.
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035722, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 17:02:02.309077 32196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: Neither blocks nor log segments found. Creating new log.
I20260806 17:02:02.310139 32196 log.cc:824] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: Log is configured to *not* fsync() on all Append() calls
I20260806 17:02:02.312772 32196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: No bootstrap required, opened a new log
I20260806 17:02:02.313108 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.304300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46866 (local address 127.7.153.61:46359)
0806 17:02:02.304423 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.304428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.304442 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:02:02.304532 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.304535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.304580 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.304677 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.305162 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.305697 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.306541 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.306784 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.306900 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.309292 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.309298 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.309304 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.309339 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.311154 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.311679 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.311683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.311685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.311780 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.312114 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.312119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.312124 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.312361 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.312480 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.312791 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.312925 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 17:02:02.313144 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.304205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.61:46359 (local address 127.0.0.1:46866)
0806 17:02:02.304317 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.304333 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.304424 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.304722 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.304726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.304931 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.305041 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.305047 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.305817 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.305822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.306411 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.306425 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.306903 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.306907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.307018 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.307592 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.307604 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.309114 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.311289 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.311293 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.311295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.311561 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.311889 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.311892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.311893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.311992 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.312480 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.312483 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.312591 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.312726 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.312995 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 17:02:02.314311 32277 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.62@KRBTEST.COM
I20260806 17:02:02.317453 32196 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.317775 32196 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e44838e8cd45b8bf0c2b202e9270b9, State: Initialized, Role: FOLLOWER
I20260806 17:02:02.318161 32196 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.318755 32284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.319044 32284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.319832 32196 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:02:02.320863 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.309493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48052 (local address 127.7.153.62:39259)
0806 17:02:02.309642 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.309649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.310055 (+ 406us) server_negotiation.cc:407] Connection header received
0806 17:02:02.310184 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.310190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.310269 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.310379 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.311363 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.312034 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.313117 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.313431 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.313513 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.316504 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.316508 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.316511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.316547 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.318536 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.319113 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.319119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.319125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.319234 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.319613 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.319617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.319619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.319864 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.320113 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.320514 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.320660 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035722, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.60@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
I20260806 17:02:02.326053 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.314870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60072)
0806 17:02:02.314991 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.315004 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.315082 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.317240 (+ 2158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.317243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.317386 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.317454 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.317459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.318508 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.318511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.319239 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.319250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.319838 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.319841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.319918 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.320408 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.320429 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.321970 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.324274 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.324277 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.324279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.324612 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.324918 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.324923 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.324925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.324993 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.325485 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.325488 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.325570 (+ 82us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.325664 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.325816 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 17:02:02.326062 32296 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:02:02.326139 32296 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:02:02.326660 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.314893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60072 (local address 127.7.153.60:38359)
0806 17:02:02.316907 (+ 2014us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.316914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.316929 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:02:02.316966 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.316969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.317016 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.317098 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.317613 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.318379 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.319369 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.319719 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.319837 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.322155 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.322161 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.322165 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.322193 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.324166 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.324744 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.324748 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.324751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.324829 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.325083 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.325085 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.325087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.325361 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.325454 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.326387 (+ 933us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.326511 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1903}
I20260806 17:02:02.324301 32122 master_runner.cc:186] Error getting master registration for 127.7.153.62:39259: OK, instance_id { permanent_uuid: "802be78db6794c378d0316a06ed64695" instance_seqno: 1786035721794182 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 17:02:02.328281 32122 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.153.61@KRBTEST.COM
I20260806 17:02:02.330238 32277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: Bootstrap starting.
I20260806 17:02:02.333539 32277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: Neither blocks nor log segments found. Creating new log.
I20260806 17:02:02.334390 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.322798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46880 (local address 127.7.153.61:46359)
0806 17:02:02.323399 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.323404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.323418 (+ 14us) server_negotiation.cc:407] Connection header received
0806 17:02:02.323457 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.323460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.323506 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.323583 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.324736 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.325476 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.326906 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.327251 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.327352 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.330414 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.330418 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.330421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.330451 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.332132 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.332680 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.332684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.332686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.332840 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.333197 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.333200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.333203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.333485 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.333689 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.334081 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.334220 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293}
I20260806 17:02:02.334560 32277 log.cc:824] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: Log is configured to *not* fsync() on all Append() calls
I20260806 17:02:02.337109 32277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: No bootstrap required, opened a new log
I20260806 17:02:02.338562 7780 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 17:02:02.341244 32277 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.341472 32277 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3abbfcd511e433b85531f153a92038d, State: Initialized, Role: FOLLOWER
I20260806 17:02:02.340065 32086 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "802be78db6794c378d0316a06ed64695"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48052
I20260806 17:02:02.341749 32277 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.342242 32299 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.342381 32299 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.343261 32277 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: configured and running, proceeding with master startup.
W20260806 17:02:02.349399 32311 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:02:02.349503 32311 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:02:02.347666 32203 master_runner.cc:186] Error getting master registration for 127.7.153.62:39259: OK, instance_id { permanent_uuid: "802be78db6794c378d0316a06ed64695" instance_seqno: 1786035721794182 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 17:02:02.351151 32203 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 17:02:02.437716 32115 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } attempt: 4
Aug 06 17:02:02 dist-test-slave-cbsf krb5kdc[32031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786035721, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.153.62@KRBTEST.COM for kudu/127.7.153.60@KRBTEST.COM
I20260806 17:02:02.448534 32118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.438412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.153.60:38359 (local address 127.0.0.1:60082)
0806 17:02:02.438648 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 17:02:02.438664 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 17:02:02.438781 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 17:02:02.439117 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 17:02:02.439120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 17:02:02.439359 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0806 17:02:02.439479 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.439486 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.440485 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.440489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.441289 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 17:02:02.441305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.441930 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.441937 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 17:02:02.442050 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.442655 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 17:02:02.442672 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 17:02:02.444398 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 17:02:02.446585 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.446588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.446591 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.446860 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.447237 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 17:02:02.447240 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 17:02:02.447242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 17:02:02.447353 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 17:02:02.447934 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 17:02:02.447938 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 17:02:02.448058 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 17:02:02.448182 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 17:02:02.448341 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260806 17:02:02.448840 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.438531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60082 (local address 127.7.153.60:38359)
0806 17:02:02.438672 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.438676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.438749 (+ 73us) server_negotiation.cc:407] Connection header received
0806 17:02:02.438901 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.438905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.438962 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.439067 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.439615 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.440346 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.441440 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.441793 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.441899 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.444560 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.444564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.444567 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.444598 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.446446 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.446994 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.447011 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.447013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.447128 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.447465 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.447468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.447470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.447790 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.447885 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.448248 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.448434 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 17:02:02.452260 32115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695: Bootstrap starting.
I20260806 17:02:02.455318 32115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695: Neither blocks nor log segments found. Creating new log.
I20260806 17:02:02.456283 32115 log.cc:824] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695: Log is configured to *not* fsync() on all Append() calls
I20260806 17:02:02.458712 32115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695: No bootstrap required, opened a new log
I20260806 17:02:02.461961 32115 raft_consensus.cc:348] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.462220 32115 raft_consensus.cc:729] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802be78db6794c378d0316a06ed64695, State: Initialized, Role: FOLLOWER
I20260806 17:02:02.462569 32115 consensus_queue.cc:260] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.463303 32314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.463686 32314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.464284 32115 sys_catalog.cc:564] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 17:02:02.464334 32086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 17:02:02.464447 32086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:02:02.466041 32086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.467195 32086 leader_election.cc:288] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [CANDIDATE]: Term 1 election: Requested vote from peers 78e44838e8cd45b8bf0c2b202e9270b9 (127.7.153.61:46359), d3abbfcd511e433b85531f153a92038d (127.7.153.60:38359)
I20260806 17:02:02.468888 32168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802be78db6794c378d0316a06ed64695" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "78e44838e8cd45b8bf0c2b202e9270b9"
I20260806 17:02:02.469211 32168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:02:02.470878 32168 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802be78db6794c378d0316a06ed64695 in term 1.
W20260806 17:02:02.470928 32326 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 17:02:02.471022 32326 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 17:02:02.471510 32246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "802be78db6794c378d0316a06ed64695" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d3abbfcd511e433b85531f153a92038d"
I20260806 17:02:02.471868 32246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [term 0 FOLLOWER]: Advancing to term 1
I20260806 17:02:02.473294 32246 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802be78db6794c378d0316a06ed64695 in term 1.
I20260806 17:02:02.474942 32060 leader_election.cc:302] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 802be78db6794c378d0316a06ed64695, d3abbfcd511e433b85531f153a92038d; no voters:
I20260806 17:02:02.482352 32044 master_runner.cc:263] No leader master found from master 802be78db6794c378d0316a06ed64695
I20260806 17:02:02.482453 32044 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 17:02:02.482738 32314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 17:02:02.483089 32314 raft_consensus.cc:686] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [term 1 LEADER]: Becoming Leader. State: Replica: 802be78db6794c378d0316a06ed64695, State: Running, Role: LEADER
I20260806 17:02:02.483558 32314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } }
I20260806 17:02:02.486418 32314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802be78db6794c378d0316a06ed64695. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.486646 32314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: This master's current role is: LEADER
I20260806 17:02:02.487124 32337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 17:02:02.488257 32337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 17:02:02.497109 32246 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [term 1 FOLLOWER]: Refusing update from remote peer 802be78db6794c378d0316a06ed64695: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:02:02.501618 32335 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:02:02.507154 32299 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802be78db6794c378d0316a06ed64695. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.507329 32299 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.509524 32168 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [term 1 FOLLOWER]: Refusing update from remote peer 802be78db6794c378d0316a06ed64695: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 17:02:02.510385 32335 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 17:02:02.514730 32284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 802be78db6794c378d0316a06ed64695. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.514875 32284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.517424 32200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.481680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46896 (local address 127.7.153.61:46359)
0806 17:02:02.481816 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.481821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.483985 (+ 2164us) server_negotiation.cc:407] Connection header received
0806 17:02:02.484482 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.484485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.484570 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.484629 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.489051 (+ 4422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.489825 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.494352 (+ 4527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.494751 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.494852 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.505925 (+ 11073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.505930 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.505933 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.505974 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.507841 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.513481 (+ 5640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.513485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.513487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.513606 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.515398 (+ 1792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.515402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.515404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.515672 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.515801 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.517081 (+ 1280us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.517263 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 17:02:02.517560 32224 tablet.cc:2369] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 17:02:02.518009 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.473374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48060 (local address 127.7.153.62:39259)
0806 17:02:02.473525 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.473531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.482369 (+ 8838us) server_negotiation.cc:407] Connection header received
0806 17:02:02.482581 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.482585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.482647 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.482702 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.486919 (+ 4217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.487742 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.493109 (+ 5367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.493452 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.493551 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.508498 (+ 14947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.508503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.508515 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.508551 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.510415 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.513765 (+ 3350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.513770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.513772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.513877 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.514383 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.514388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.514390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.514663 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.514790 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.517713 (+ 2923us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.517854 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 17:02:02.518143 32335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.518328 32335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: This master's current role is: LEADER
I20260806 17:02:02.519487 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:02.481989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60098 (local address 127.7.153.60:38359)
0806 17:02:02.482119 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.482123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.484361 (+ 2238us) server_negotiation.cc:407] Connection header received
0806 17:02:02.485831 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.485834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.485889 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.485940 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.491092 (+ 5152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.491876 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.500856 (+ 8980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:02.501260 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:02.501359 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:02.511058 (+ 9699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 17:02:02.511062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 17:02:02.511065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 17:02:02.511100 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 17:02:02.512921 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.514881 (+ 1960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.514886 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.514888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.514984 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 17:02:02.516315 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 17:02:02.516322 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 17:02:02.516325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 17:02:02.516576 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 17:02:02.516688 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:02.519178 (+ 2490us) server_negotiation.cc:299] Negotiation successful
0806 17:02:02.519311 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260806 17:02:02.521932 32146 tablet.cc:2369] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 17:02:02.522486 32340 mvcc.cc:205] Tried to move back new op lower bound from 7315602319337971712 to 7315602319298146304. Current Snapshot: MvccSnapshot[applied={T|T < 7315602319337971712}]
I20260806 17:02:02.522604 32299 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.522723 32299 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.523790 32338 mvcc.cc:205] Tried to move back new op lower bound from 7315602319337971712 to 7315602319298146304. Current Snapshot: MvccSnapshot[applied={T|T < 7315602319337971712}]
I20260806 17:02:02.526636 32314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.526811 32314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695 [sys.catalog]: This master's current role is: LEADER
I20260806 17:02:02.528148 32284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "802be78db6794c378d0316a06ed64695" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802be78db6794c378d0316a06ed64695" member_type: VOTER last_known_addr { host: "127.7.153.62" port: 39259 } } peers { permanent_uuid: "78e44838e8cd45b8bf0c2b202e9270b9" member_type: VOTER last_known_addr { host: "127.7.153.61" port: 46359 } } peers { permanent_uuid: "d3abbfcd511e433b85531f153a92038d" member_type: VOTER last_known_addr { host: "127.7.153.60" port: 38359 } } }
I20260806 17:02:02.528281 32284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 17:02:02.529314 32342 mvcc.cc:205] Tried to move back new op lower bound from 7315602319337971712 to 7315602319298146304. Current Snapshot: MvccSnapshot[applied={T|T < 7315602319337971712}]
I20260806 17:02:02.534495 32337 catalog_manager.cc:1347] Generated new cluster ID: dd7a7f3dff924486a139e2e986738e9e
I20260806 17:02:02.534587 32337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 17:02:02.554251 32337 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 17:02:02.555680 32337 catalog_manager.cc:1504] Loading token signing keys...
I20260806 17:02:02.571414 32337 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 802be78db6794c378d0316a06ed64695: Generated new TSK 0
I20260806 17:02:02.572512 32337 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 17:02:02.602455 32119 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.600666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48062 (local address 127.7.153.62:39259)
0806 17:02:02.600832 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.600837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.601126 (+ 289us) server_negotiation.cc:407] Connection header received
0806 17:02:02.601393 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.601399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.601460 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.601525 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.602313 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48062: BlockingRecv error: recv got EOF from 127.0.0.1:48062 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260806 17:02:02.602455 32282 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.600787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60110 (local address 127.7.153.60:38359)
0806 17:02:02.600940 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.600945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.601376 (+ 431us) server_negotiation.cc:407] Connection header received
0806 17:02:02.601544 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.601547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.601595 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.601651 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.602295 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60110: BlockingRecv error: recv got EOF from 127.0.0.1:60110 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260806 17:02:02.602753 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.601404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.7.153.61:46359)
0806 17:02:02.601533 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.601538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.601768 (+ 230us) server_negotiation.cc:407] Connection header received
0806 17:02:02.601960 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.601963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.602011 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.602063 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.602632 (+ 569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46906: BlockingRecv error: recv got EOF from 127.0.0.1:46906 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 17:02:02.606660 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.605378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46910 (local address 127.7.153.61:46359)
0806 17:02:02.605501 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.605506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.605807 (+ 301us) server_negotiation.cc:407] Connection header received
0806 17:02:02.605915 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.605917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.605991 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.606067 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.606531 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46910: BlockingRecv error: recv got EOF from 127.0.0.1:46910 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260806 17:02:02.611230 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.610312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46924 (local address 127.7.153.61:46359)
0806 17:02:02.610438 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.610441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.610453 (+ 12us) server_negotiation.cc:407] Connection header received
0806 17:02:02.610502 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.610504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.610547 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.610665 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.611106 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46924: BlockingRecv error: recv got EOF from 127.0.0.1:46924 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 17:02:02.616552 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.615302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46926 (local address 127.7.153.61:46359)
0806 17:02:02.615467 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.615487 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.615513 (+ 26us) server_negotiation.cc:407] Connection header received
0806 17:02:02.615707 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.615711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.615772 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.615876 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.616377 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46926: BlockingRecv error: recv got EOF from 127.0.0.1:46926 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260806 17:02:02.624420 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.623039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.7.153.61:46359)
0806 17:02:02.623220 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.623226 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.623360 (+ 134us) server_negotiation.cc:407] Connection header received
0806 17:02:02.623500 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.623504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.623573 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.623689 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.624291 (+ 602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46930: BlockingRecv error: recv got EOF from 127.0.0.1:46930 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260806 17:02:02.636006 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.634684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46942 (local address 127.7.153.61:46359)
0806 17:02:02.634823 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.634828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.635092 (+ 264us) server_negotiation.cc:407] Connection header received
0806 17:02:02.635220 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.635224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.635296 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.635394 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.635867 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46942: BlockingRecv error: recv got EOF from 127.0.0.1:46942 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 17:02:02.656041 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.654359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46954 (local address 127.7.153.61:46359)
0806 17:02:02.654521 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.654526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.654858 (+ 332us) server_negotiation.cc:407] Connection header received
0806 17:02:02.655126 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.655130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.655203 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.655335 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.655908 (+ 573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46954: BlockingRecv error: recv got EOF from 127.0.0.1:46954 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 17:02:02.691704 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.690559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46956 (local address 127.7.153.61:46359)
0806 17:02:02.690711 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.690716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.690832 (+ 116us) server_negotiation.cc:407] Connection header received
0806 17:02:02.690949 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.690952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.691004 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.691093 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.691595 (+ 502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46956: BlockingRecv error: recv got EOF from 127.0.0.1:46956 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 17:02:02.760393 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.758497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46960 (local address 127.7.153.61:46359)
0806 17:02:02.758845 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.758852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.759097 (+ 245us) server_negotiation.cc:407] Connection header received
0806 17:02:02.759539 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.759544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.759625 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.759717 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.760263 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46960: BlockingRecv error: recv got EOF from 127.0.0.1:46960 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260806 17:02:02.892097 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:02.890746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46964 (local address 127.7.153.61:46359)
0806 17:02:02.890928 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:02.890932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:02.891167 (+ 235us) server_negotiation.cc:407] Connection header received
0806 17:02:02.891367 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:02.891371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:02.891425 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:02.891515 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:02.891991 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46964: BlockingRecv error: recv got EOF from 127.0.0.1:46964 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260806 17:02:03.152040 32200 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 17:02:03.150852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46980 (local address 127.7.153.61:46359)
0806 17:02:03.151019 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:03.151023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:03.151118 (+ 95us) server_negotiation.cc:407] Connection header received
0806 17:02:03.151258 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:03.151260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:03.151311 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:03.151410 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 17:02:03.151896 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46980: BlockingRecv error: recv got EOF from 127.0.0.1:46980 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 17:02:03.327615 32296 catalog_manager.cc:1259] Loaded cluster ID: dd7a7f3dff924486a139e2e986738e9e
I20260806 17:02:03.327703 32296 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: loading cluster ID for follower catalog manager: success
I20260806 17:02:03.329572 32296 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: acquiring CA information for follower catalog manager: success
I20260806 17:02:03.330847 32296 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 78e44838e8cd45b8bf0c2b202e9270b9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 17:02:03.350903 32311 catalog_manager.cc:1259] Loaded cluster ID: dd7a7f3dff924486a139e2e986738e9e
I20260806 17:02:03.350996 32311 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: loading cluster ID for follower catalog manager: success
I20260806 17:02:03.352887 32311 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: acquiring CA information for follower catalog manager: success
I20260806 17:02:03.354391 32311 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d3abbfcd511e433b85531f153a92038d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 17:02:03.670917 32415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:03.666637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46994 (local address 127.7.153.61:46359)
0806 17:02:03.666938 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:03.666941 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:03.666958 (+ 17us) server_negotiation.cc:407] Connection header received
0806 17:02:03.667098 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:03.667101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:03.667243 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:03.667348 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:03.667626 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.668164 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.669218 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.669472 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.669570 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:03.669939 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:03.670422 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:03.670524 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:03.670623 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 17:02:03.670696 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":85,"threads_started":1}
I20260806 17:02:03.679371 32421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:03.675202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60112 (local address 127.7.153.60:38359)
0806 17:02:03.675502 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:03.675505 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:03.675520 (+ 15us) server_negotiation.cc:407] Connection header received
0806 17:02:03.675741 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:03.675745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:03.675880 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:03.675995 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:03.676241 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.676874 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.677745 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.677993 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.678076 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:03.678399 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:03.678897 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:03.678993 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:03.679099 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 17:02:03.679156 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":90,"threads_started":1}
I20260806 17:02:03.687458 32421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:03.683163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60120 (local address 127.7.153.60:38359)
0806 17:02:03.683310 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:03.683316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:03.683518 (+ 202us) server_negotiation.cc:407] Connection header received
0806 17:02:03.683707 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:03.683711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:03.683770 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:03.683818 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:03.684243 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.685035 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.686081 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.686427 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.686528 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:03.686909 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:03.687014 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:03.687064 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:03.687246 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 17:02:03.687311 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 17:02:03.687968 32415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:03.683629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47008 (local address 127.7.153.61:46359)
0806 17:02:03.683809 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:03.683813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:03.684052 (+ 239us) server_negotiation.cc:407] Connection header received
0806 17:02:03.684273 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:03.684276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:03.684329 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:03.684405 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:03.684666 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.685444 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.686533 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.686814 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.686894 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:03.687321 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:03.687410 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:03.687457 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:03.687768 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 17:02:03.687835 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 17:02:03.688177 32428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 17:02:03.683133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48076 (local address 127.7.153.62:39259)
0806 17:02:03.683433 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 17:02:03.683440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 17:02:03.683464 (+ 24us) server_negotiation.cc:407] Connection header received
0806 17:02:03.683722 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 17:02:03.683725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 17:02:03.683918 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 17:02:03.684052 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 17:02:03.684333 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.685076 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.686218 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 17:02:03.686594 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 17:02:03.686699 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 17:02:03.687113 (+ 414us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 17:02:03.687508 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 17:02:03.687614 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 17:02:03.687948 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 17:02:03.688025 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":94,"threads_started":1}
I20260806 17:02:03.698220 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 32044
I20260806 17:02:03.707878 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 32122
I20260806 17:02:03.716810 7780 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ6ny6/build/debug/bin/kudu with pid 32203
2026-08-06T17:02:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3366 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6813 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (307079 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST